CeWL Package Description

CeWL is a ruby app which spiders a given url to a specified depth, optionally following external links, and returns a list of words which can then be used for password crackers such as John the Ripper.

CeWL also has an associated command line app, FAB (Files Already Bagged) which uses the same meta data extraction techniques to create author/creator lists from already downloaded.

Source: http://www.digininja.org/projects/cewl.php
CeWL Homepage | Kali CeWL Repo

• Author: Robin Wood
• License: Creative Commons Attribution-Share Alike 2.0

tools included in the cewl package

cewl – Custom wordlist generator

[email protected]:~# cewl --help
CeWL 5.0 Robin Wood ([email protected]) (www.digininja.org)

Usage: cewl [OPTION] ... URL
    --help, -h: show help
    --keep, -k: keep the downloaded file
    --depth x, -d x: depth to spider to, default 2
    --min_word_length, -m: minimum word length, default 3
    --offsite, -o: let the spider visit other sites
    --write, -w file: write the output to the file
    --ua, -u user-agent: useragent to send
    --no-words, -n: don't output the wordlist
    --meta, -a include meta data
    --meta_file file: output file for meta data
    --email, -e include email addresses
    --email_file file: output file for email addresses
    --meta-temp-dir directory: the temporary directory used by exiftool when parsing files, default /tmp
    --count, -c: show the count for each word found

    Authentication
    --auth_type: digest or basic
    --auth_user: authentication username
    --auth_pass: authentication password

    Proxy Support
    --proxy_host: proxy host
    --proxy_port: proxy port, default 8080
    --proxy_username: username for proxy, if required
    --proxy_password: password for proxy, if required

    --verbose, -v: verbose

    URL: The site to spider.

fab – Files Already Bagged

[email protected]:~# fab --help
xx

Usage: xx [OPTION] ... filename/list
    -h, --help: show help
    -v: verbose

    filename/list: the file or list of files to check

cewl Usage Example

Scan to a depth of 2 (-d 2) and use a minimum word length of 5 (-m 5), save the words to a file (-w docswords.txt), targeting the given URL (http://docs.kali.org):

[email protected]:~# cewl -d 2 -m 5 -w docswords.txt http://docs.kali.org
CeWL 5.0 Robin Wood ([email protected]) (www.digininja.org)

[email protected]:~# wc -l docswords.txt
4093 docswords.txt