tb - manipulation tool for table: CSV, TSV, JSON, etc.
tb provides a command and a library for manipulating tables: Unix filter like operations (grep, sort, cat, cut, ls, etc.), SQL like operations (join, group, etc.), other table operations (gsub, rename, cross, melt, unmelt, etc.), information extractions (git-log, svn-log, tar-tvf), and more.
There is a CSV file for programming languages and their birth year in sample/ directory in tb package.
% head sample/langs.csv language,year FORTRAN,1955 LISP,1958 COBOL,1959 ALGOL 58,1958 APL,1962 Simula,1962 SNOBOL,1962 BASIC,1964 PL/I,1964
“tb” command has many subcommands. “sort” subcommand sort a CSV file. You don't need to care header: header is retained as is.
% tb sort sample/langs.csv|head language,year ALGOL 58,1958 APL,1962 Ada,1983 B,1969 BASIC,1964 BCPL,1967 C,1972 C#,2001 C++,1980
“sort” subcommand takes -f option to specify a field to sort. You don't need to count the position of the field. Also, the comparison method used in tb is smart to sort numbers correctly.
% tb sort -f year sample/langs.csv|head language,year FORTRAN,1955 LISP,1958 ALGOL 58,1958 COBOL,1959 APL,1962 SNOBOL,1962 Simula,1962 BASIC,1964 PL/I,1964
“grep” subcommand search CSV file.
% tb grep R sample/langs.csv language,year FORTRAN,1955 Ruby,1993
“grep” subcommand takes -f with field name and -v to show non-matching rows. You don't need to care field separators (comma) to match. Following example searches languages which name contains a non-alphabet character.
% tb grep -vf language '\A[A-Za-z]*\z' sample/langs.csv |cat language,year ALGOL 58,1958 PL/I,1964 C++,1980 Objective-C,1983 Common Lisp,1984 Visual Basic,1991 C#,2001 F#,2002
“grep” subcommand can take Ruby expression, instead of a regexp. The variable, “_”, contains a hash which represents a record.
“cut” subcommand extract one or more fields. This is similar to “cut” command of Unix and projection of relational algebra.
% tb cut language sample/langs.csv |head language FORTRAN LISP COBOL ALGOL 58 APL Simula SNOBOL BASIC PL/I
“group” subcommand groups rows for specified field. -a option specifies aggregation expression to aggregate the grouped rows.
% tb group year -a count -a 'values(language)' sample/langs.csv |head year,count,values(language) 1955,1,FORTRAN 1958,2,"LISP,ALGOL 58" 1959,1,COBOL 1962,3,"APL,Simula,SNOBOL" 1964,2,"BASIC,PL/I" 1967,1,BCPL 1968,1,Logo 1969,1,B 1970,2,"Pascal,Forth"
There are more subcommands. “help” subcommand shows list of subcommand.
% tb help Usage: tb help [OPTS] [SUBCOMMAND] tb to-csv [OPTS] [TABLE ...] tb to-tsv [OPTS] [TABLE] tb to-pnm [OPTS] [TABLE] tb to-json [OPTS] [TABLE] tb to-yaml [OPTS] [TABLE] tb to-pp [OPTS] [TABLE] tb grep [OPTS] REGEXP [TABLE ...] tb gsub [OPTS] REGEXP STRING [TABLE ...] tb sort [OPTS] [TABLE] tb cut [OPTS] FIELD,... [TABLE] tb rename [OPTS] SRC,DST,... [TABLE] tb newfield [OPTS] FIELD RUBY-EXP [TABLE] tb cat [OPTS] [TABLE ...] tb join [OPTS] [TABLE1 TABLE2 ...] tb consecutive [OPTS] [TABLE ...] tb group [OPTS] KEY-FIELD1,... [TABLE ...] tb cross [OPTS] VKEY-FIELD1,... HKEY-FIELD1,... [TABLE ...] tb melt KEY-FIELDS-LIST [OPTS] [TABLE ...] tb unmelt [OPTS] [TABLE ...] tb nest [OPTS] NEWFIELD,OLDFIELD1,OLDFIELD2,... [TABLE ...] tb unnest [OPTS] FIELD [TABLE ...] tb shape [OPTS] [TABLE ...] tb mheader [OPTS] [TABLE] tb crop [OPTS] [TABLE ...] tb ls [OPTS] [FILE ...] tb tar-tvf [OPTS] [TAR-FILE ...] tb svn-log [OPTS] -- [SVN-LOG-ARGS] tb git-log [OPTS] [GIT-DIR ...]
tb help -s shows one line summary of the subcommands.
gem install tb
((<source repository on github|URL:github.com/akr/tb>))
((<tb on rubygems.org|URL:rubygems.org/gems/tb>))
Tanaka Akira <[email protected]>
Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. 3. The name of the author may not be used to endorse or promote products derived from this software without specific prior written permission.
THIS SOFTWARE IS PROVIDED BY THE AUTHOR “AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
(The modified BSD licence)