1cli

您所在的位置：网站首页 › cs223 › 1cli

1cli

#1cli| 来源: 网络整理| 查看: 265

1cli

Use JavaScript code snippets within "one-line" shell command-lines for file munging.

Special support for json, jsonl, comma-separated csv files, tab-separated csv files and pipe | separated csv files.

Short names for useful functionality:

_ represents the current "line".

_p(...) like console.log(...).

_j(o) convert o to/from json.

For example, to convert a .csv file to a .jsonl file:

# show contents of csv file: $ cat examples/vm-ips.csv user,course,ip john,cs123,192.168.1.2 bill,cs223,192.168.1.3 mary,cs123,10.1.2.3 sue,cs223,192.168.1.4 # convert $ $ 1cli -e '_p(_j(_))' examples/vm-ips.csv ; ~/tmp/vm-ips.jsonl # show result $ cat ~/tmp/vm-ips.jsonl {"user":"john","course":"cs123","ip":"192.168.1.2"} {"user":"bill","course":"cs223","ip":"192.168.1.3"} {"user":"mary","course":"cs123","ip":"10.1.2.3"} {"user":"sue","course":"cs223","ip":"192.168.1.4"} $

The .csv extension on the input file results in it being read into a list of object. The -e --eval option will run provided code block _p(_j(_)), printing out each csv object as json.

The following example shows converting the same file vm-ips.csv into a json file with keys for each user:

$ 1cli -e 'BEGIN o={}' -e 'o[_.user]=_' -e 'END _p(_j(o))' \ examples/vm-ips.csv ;~/tmp/vm-ips.json #show output (edited for limiting line length) $ cat ~/tmp/vm-ips.json {"john":{"user":"john","course":"cs123","ip":"192.168.1.2"}, "bill":{"user":"bill","course":"cs223","ip":"192.168.1.3"}, "mary":{"user":"mary","course":"cs123","ip":"10.1.2.3"}, "sue":{"user":"sue","course":"cs223","ip":"192.168.1.4"} } $

The BEGIN code block is executed only once at the start of the script and is used to set up an empty object o. The subsequent code block adds each csv object to the o object under its user key.

The following example filters vm-ips.csv to produce a jsonl contains all csv objects have ip's starting with 10.

$ 1cli -e '_.ip.startsWith('10.') ;; _p(_j(_))' examples/vm-ips.csv {"user":"mary","course":"cs123","ip":"10.1.2.3"} $

The following example uses the previously generated vm-ips.json file along with a new student-info.jsonl file to join entries for the same id's. Note that we match the user field to the portion before the @ of the email from the student-info.jsonl file:

# show student-infos.jsonl input file $ cat examples/student-info.jsonl { "id": "123-465-mar", "first": "Mary", "last": "Traub", "email": "[email protected]" } { "id": "132-456-sue", "first": "Sue", "last": "Rawls", "email": "[email protected]" } { "id": "123-456-jhn", "first": "John", "last": "Smith", "email": "[email protected]" } { "id": "123-456-bil", "first": "Bill", "last": "Gray", "email": "[email protected]" } # join user from vm-ips.json to email id from student-infos.json $ 1cli -e 'u=_.email.m(/^[^@]+/)[0]; x={..._contents[0][u], ..._}; _p(_j(x))' \ ~/tmp/vm-ips.json examples/student-info.jsonl \ ; ~/tmp/student-vm-ips.jsonl # show results (edited for line-length) $ cat ~/tmp/student-vm-ips.jsonl {"user":"mary","course":"cs123","ip":"10.1.2.3","id":"123-465-mar", "first":"Mary","last":"Traub","email":"[email protected]"} {"user":"sue","course":"cs223","ip":"192.168.1.4","id":"132-456-sue", "first":"Sue","last":"Rawls","email":"[email protected]"} {"user":"john","course":"cs123","ip":"192.168.1.2","id":"123-456-jhn", "first":"John","last":"Smith","email":"[email protected]"} {"user":"bill","course":"cs223","ip":"192.168.1.3","id":"123-456-bil", "first":"Bill","last":"Gray","email":"[email protected]"} $

Here is the manual produced using the --man option:

$ 1cli --man Usage: 1cli [options] [...path] Options: -d, --debug output generated functions on stderr -e, --eval evaluate . Can be specified multiple times. If --loop, then evaluate for each _ "line". If starts with BEGIN/END then evaluate only at start/end. (default: []) -f, --field-sep use to split _ line into _0, _1, ... when --loop (default: "/\\s+/") -h, --help display help for command -l, --no-loop run code only once -L, --loop repeat code for each _ "line" (default: true) -m, --no-monkey do not monkey-patch standard classes -M, --monkey monkey-patch standard classes (default: true) --man output manual on stdout -p, --no-print do not print _ "line" after each loop iteration -P, --print print _ "line" after each loop iteration (default: false) --src

【本文地址】

1cli

1cli

今日新闻

推荐新闻