什么是JSON的好的CLI工具？(What are good CLI tools for JSON?)

 一般问题 
 
 虽然我可能正在诊断事件的根本原因，确定其影响的用户数量，或者蒸馏计时日志，以评估最近代码更改的性能和吞吐量影响，但我的工具保持不变： grep ， awk ， sed ， tr ， uniq ， sort ， zcat ， tail ， head ， join和split 。 为了将它们粘合在一起，Unix给了我们管道，而对于鸽友过滤我们有xargs 。 如果这些让我失望了，总是会有这样的。 
 
 这些工具非常适用于处理CSV文件，制表符分隔文件，具有可预测行格式的日志文件，或以逗号分隔的键值对的文件。 换句话说，每一行都没有上下文的文件。 
 
 XML类似物 
 
 我最近需要通过千兆字节的XML来构建用户使用的直方图。 这是很简单的工具，我有，但对于更复杂的查询，正常的方法分解。 说我有这样的项目的文件： 
 
<foo user="me">
    <baz key="zoidberg" value="squid" />
    <baz key="leela"    value="cyclops" />
    <baz key="fry"      value="rube" />
</foo>
 
 而且我想说，我想要生成一个从<foo>用户到平均值<baz>的映射。 逐行处理不再是一个选择：我需要知道我正在检查哪个用户的<foo>所以我知道要更新的平均值。 任何一种完成这项任务的Unix一个班轮都可能是不可思议的。 
 
 幸运的是，在XML-land中，我们有很好的技术，如XPath，XQuery和XSLT来帮助我们。 
 
 以前，我习惯使用精彩的XML::XPath Perl模块来完成上述的查询，但是在找到可以对我当前窗口运行XPath表达式的TextMate插件后，我停止写一次性Perl脚本查询XML。 而且我刚刚发现了关于正在安装的XMLStarlet ，当我输入这个，我期望在将来使用它。 
 
 JSON解决方案？ 
 
 所以这引起了我的问题：JSON有什么工具吗？ 这只是一个时间问题，一些调查任务要求我对JSON文件进行类似的查询，而没有像XPath和XSLT这样的工具，这样的任务会变得更加困难。 如果我有一堆像这样的JSON： 
 
{
  "firstName": "Bender",
  "lastName": "Robot",
  "age": 200,
  "address": {
    "streetAddress": "123",
    "city": "New York",
    "state": "NY",
    "postalCode": "1729"
  },
  "phoneNumber": [
    { "type": "home", "number": "666 555-1234" },
    { "type": "fax", "number": "666 555-4567" }
  ]
}
 
 并且想要找到每个人的平均电话号码，我可以用XPath做这样的事情： 
 
fn:avg(/fn:count(phoneNumber))
 
 问题 
 
 
 
 有没有任何可以以这种方式“查询”JSON文件的命令行工具？ 
 
 
 如果您必须在Unix命令行上处理一堆JSON文件，您使用什么工具？ 
 
 
 哎呀，有没有为JSON做这样的查询语言呢？ 
 
 
 如果你在日常工作中使用这样的工具，你喜欢/不喜欢什么呢？ 有什么问题吗？ 
 
 
 我注意到越来越多的数据序列化正在使用JSON，因此在分析大量数据转储时，这样的处理工具将是至关重要的。 用于JSON的语言库非常强大，编写脚本来进行这种处理是非常简单的，但是真正让人们玩数据的工具需要使用。 
 
 相关问题 
 
 
 
 Grep和Sed等效于XML命令行处理 
 
 
 JSON有查询语言吗？ 
 
 
 JSONPath或其他XPath类似于JSON / Javascript的实用程序; 或Jquery JSON 
 

General Problem
 
Though I may be diagnosing the root cause of an event, determining how many users it affected, or distilling timing logs in order to assess the performance and throughput impact of a recent code change, my tools stay the same: grep, awk, sed, tr, uniq, sort, zcat, tail, head, join, and split. To glue them all together, Unix gives us pipes, and for fancier filtering we have xargs. If these fail me, there's always perl -e.
 
These tools are perfect for processing CSV files, tab-delimited files, log files with a predictable line format, or files with comma-separated key-value pairs. In other words, files where each line has next to no context.
 
XML Analogues
 
I recently needed to trawl through Gigabytes of XML to build a histogram of usage by user. This was easy enough with the tools I had, but for more complicated queries the normal approaches break down. Say I have files with items like this:
 
<foo user="me">
    <baz key="zoidberg" value="squid" />
    <baz key="leela"    value="cyclops" />
    <baz key="fry"      value="rube" />
</foo>
 
And let's say I want to produce a mapping from user to average number of <baz>s per <foo>. Processing line-by-line is no longer an option: I need to know which user's <foo> I'm currently inspecting so I know whose average to update. Any sort of Unix one liner that accomplishes this task is likely to be inscrutable.
 
Fortunately in XML-land, we have wonderful technologies like XPath, XQuery, and XSLT to help us.
 
Previously, I had gotten accustomed to using the wonderful XML::XPath Perl module to accomplish queries like the one above, but after finding a TextMate Plugin that could run an XPath expression against my current window, I stopped writing one-off Perl scripts to query XML. And I just found out about XMLStarlet which is installing as I type this and which I look forward to using in the future.
 
JSON Solutions?
 
So this leads me to my question: are there any tools like this for JSON? It's only a matter of time before some investigation task requires me to do similar queries on JSON files, and without tools like XPath and XSLT, such a task will be a lot harder. If I had a bunch of JSON that looked like this:
 
{
  "firstName": "Bender",
  "lastName": "Robot",
  "age": 200,
  "address": {
    "streetAddress": "123",
    "city": "New York",
    "state": "NY",
    "postalCode": "1729"
  },
  "phoneNumber": [
    { "type": "home", "number": "666 555-1234" },
    { "type": "fax", "number": "666 555-4567" }
  ]
}
 
And wanted to find the average number of phone numbers each person had, I could do something like this with XPath:
 
fn:avg(/fn:count(phoneNumber))
 
Questions
 
 
 
Are there any command-line tools that can "query" JSON files in this way?
 
 
If you have to process a bunch of JSON files on a Unix command line, what tools do you use?
 
 
Heck, is there even work being done to make a query language like this for JSON?
 
 
If you do use tools like this in your day-to-day work, what do you like/dislike about them? Are there any gotchas?
 
 
I'm noticing more and more data serialization is being done using JSON, so processing tools like this will be crucial when analyzing large data dumps in the future. Language libraries for JSON are very strong and it's easy enough to write scripts to do this sort of processing, but to really let people play around with the data shell tools are needed.
 
Related Questions
 
 
 
Grep and Sed Equivalent for XML Command Line Processing
 
 
Is there a query language for JSON?
 
 
JSONPath or other XPath like utility for JSON/Javascript; or Jquery JSON
 

原文：https://stackoverflow.com/questions/2933126