Also treat hidden files?

.foo - as "other"
.foo.bar - as extension bar

are you expecting a one-liner?

because this almost requires hash tables, or associative arrays. which isn't that simple to do in bash, or any shell scripting language.

I'd much rather use python or nodejs for this task.

I'm sure an awk-ninja could do it, but that isn't strictly shell.

paste.centos.org/view/025605f5

solution

find . | while read f; do echo ${f##*.}; done | sort | uniq -c | sort -rn

one line

find $count_dir -type f -printf "%f\n" | while read file; do ext=${file##*.}; [[ "$file" == "$ext" ]] && echo other || echo $ext; done | sort -i | uniq -ci | sort -nr

find . -type f | perl -nle 'print m{[^/](\.[^/.]+)\z} ? lc $1 : "other"' | sort | uniq -c | sort -nr<br>

Remove -type f to include directories in the report (most of them will show up as "other", I expect.)

The regex in the Perl code could be simplified slightly at the cost of -printf '%f\n' in find, but that's longer.

A version without perl:

find . -type f | sed 's!^.*[^/]\(\.[^/.]\+\)$!\1!; t; c other' | sort -f | uniq -ic | sort -nr<br>

I took yesterday's Linux DFIR command line trivia from one of our old Command Line Kung Fu blog postings (Episode 99). It's an interesting challenge and useful for quickly summarizing types of files in a directory by simply collecting and counting the file extensions.

I also liked it because we get to use the "${var##pattern}" expansion, similar to my solution from a couple of days ago using "${var%%pattern}". So there's some nice symmetry.

If you read the original blog posting, my first solution used a funky "sed" substitution to whittle down to the file extensions. It was actually loyal reader and friend of the blog Jeff Haemer who suggested this much cleaner version (and to @barubary who reminded me to quote my variables) :

find Documents -type f |
while read f; do
echo "${f##*.}";
done |
sed 's/.*\/.*/other/' | tr A-Z a-z |
sort | uniq -c | sort -n

"find" gets us a list of files in the directory and then we feed that into a loop that uses "${f##*.}" to remove everything up until the final "." in the file path.

Some file names are not going to have a "." and so the original file path will be unchanged. The "sed" expression after the loop marks these files as being in category "other". Finally we shift everything to lowercase so "GIF" and "gif" are recognized as the same type. Then our usual command line histogram idiom rounds things out.

We could add some other fix-ups to make things nicer:

find Documents -type f |
while read f; do
echo "${f##*.}";
done |
sed 's/.*\/.*/other/' | tr A-Z a-z |
sed -r 's/^jpg$/jpeg/; s/(~|,v)$//' |
sort | uniq -c | sort -n

I've dropped in another "sed" expression before we start counting things. We make "jpg" and "jpeg" count the same and remove some trailing file extensions for backup files to reduce clutter in the output. This just shows that you can arbitrarily tweak the output to suit your needs.

Props to @apgarcia for getting very close to the final solution on this one!

#Linux #DFIR #CommandLine #Trivia