github
/
PenetrationTestingScripts
mirror of https://github.com/ym2011/PenetrationTestingScripts
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
PenetrationTestingScripts/User Agents
History
ym2011 d8a30a6fc7 update 2019-06-16 16:30:05 +08:00
..
csv update 2019-06-16 16:30:05 +08:00
json update 2019-06-16 16:30:05 +08:00
LICENSE update 2019-06-16 16:30:05 +08:00
README.md update 2019-06-16 16:30:05 +08:00
requirements.txt update 2019-06-16 16:30:05 +08:00
user agent example.txt update 2019-06-16 16:30:05 +08:00
useragents.py update 2019-06-16 16:30:05 +08:00

README.md

User-Agent Lists

Sometimes you need change the User-Agent string used when making alot of requests to the same server(s) often.

  • Research Purposes ONLY

That can be a hard thing to do if you only know a handful of user agents.

Not to mention building your own comprehensive list of user agent strings takes time.

In the spirit of the rfc.bib project, this project aims to make a comprehensive set of User-Agent string lists available for all to use.

Usage

Download a list today free of charge

OR

Generate the lists yourself (Requires python 3.5)

  • [sudo] pip install -r requirements.txt
  • python useragents.py --all

For more options execute python useragents.py --help

List Info

Origins

The User-Agent lists made available by this repo come from

Flavors

All list provided by this repo come in two flavors namely csv and json.

Both flavors can be found in a directory of same name and both flavors share the same "keys".

Keys

ua_org_allagents.(csv|json)

  • description: The name of the browser/bot/etc using the User-Agent string
  • ua: The User-Agent string

techpatterns_com_useragentswitcher.(csv|json)

  • kind: Is the userof the User-Agent string a browser, mobile, spider
  • description: Name version (os) for the user of the User-Agent string
  • ua: The User-Agent string

[browser].(csv|json)

  • ua: The User-Agent string
  • version: The version of the browser using the User-Agent string
  • commonality: How common is this User-Agent string

User-Agents Included By Each List

ua_org_allagents.(csv|json) provides 2460 User-Agent strings comprised of

  • Web Crawlers / Robots
  • Browsers (Older)
  • Tools (Curl, etc)
  • Scanners

techpatterns_com_useragentswitcher.(csv|json) provides 830 User-Agent strings comprised of

  • Browsers - Windows
  • Browsers - Mac
  • Browsers - Linux, Browsers - Unix
  • Mobile Devices
  • Spiders
  • Miscellaneous

[browser].(csv|json) provides 1501 User-Agent strings specific to a browser

  • chrome
  • firefox
  • safari
  • opera
  • internet-explorer
  • android

License

MIT