concatenate compressed and uncompressed logs

2010-07-15 1 min read Bash Fedora Linux

<span style="font-size: x-large;"><a href="http://feedproxy.google.com/~r/Command-line-fu/~3/iwFUyltYgjM/concatenate-compressed-and-uncompressed-logs">concatenate compressed and uncompressed logs

$ find /var/log/apache2 -name 'access.loggz' -exec <a class="zem_slink freebase/guid/9202a8c04000641f800000000001abd9" title="Gzip" rel="homepage" href="http://www.gzip.org/">zcat {} ; -or -name 'access.log' -exec cat {} ; This command allows you to stream your log files, including gziped files, into one stream which can be piped to <a class="zem_slink freebase/guid/9202a8c04000641f800000000000584b" title="AWK" rel="homepage" href="http://cm.bell-labs.com/cm/cs/awkbook/index.html">awk or some other command for analysis.

Note: if your version of &#8217;find&#8217; supports it, use:

Continue reading

The power of find command in Linux – advanced.

2010-05-24 2 min read Linux

Generally whoever uses Linux, would know about the find command. Find the man page <a href="http://amit.themafia.info/phpMan.php?parameter=find&mode=man" target="_blank">here.

There are also lots of blogs, tutorials and other articles on find command on the web, so why write another one. Because it&#8217;s worth every word spent on it πŸ™‚
find is a very powerful command, let&#8217;s see how (options for find command from man page and usage):

–depth β€” Process each directory&#8217;s contents before the directory itself.
–maxdepth β€” Descend at most <span style="text-decoration: underline;">levels (a non-negative integer) levels of directories below the command line arguments.
–xdev β€” Don&#8217;t descend directories on other filesystems.
–executable β€” Matches files which are executable and directories which are searchable (in a file name resolution sense).
This takes into account access control lists and other permissions artefacts which the -perm test ignores.
–iname β€” Like -name, but the match is case insensitive.
–nogroup β€” No group corresponds to file&#8217;s numeric group ID.
–nouser β€” No user corresponds to file&#8217;s numeric user ID.
–fls <span style="text-decoration: underline;">file β€” True; like -ls but write to <span style="text-decoration: underline;">file like -fprint.
–ok <span style="text-decoration: underline;">command β€” Like -exec but ask the user first (on the standard input);
–print0 β€” True; print the full file name on the standard output, followed by a null character
(instead of the newline character that -print uses).
–printf <span style="text-decoration: underline;">format β€” True; print <span style="text-decoration: underline;">format on the standard output, interpreting &#8217;&#8217; escapes and &#8217;%&#8217; directives.

Continue reading