Skip to content

Commit

Permalink
Fixed pattern of Nutch crawler.
Browse files Browse the repository at this point in the history
There are instances that only identify themselves with an upper case letter at the beginning. The original instances currently known also contain the pattern with the upper case letter.
  • Loading branch information
haumacher authored Apr 19, 2024
1 parent 0ef518e commit ac02b7a
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion crawler-user-agents.json
Original file line number Diff line number Diff line change
Expand Up @@ -246,8 +246,9 @@
}
,
{
"pattern": "nutch",
"pattern": "Nutch",
"instances": [
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/605.1.16 (KHTML, like Gecko; compatible; Friendly_Crawler/2.0) Chrome/120.0.6099.217 Safari/605.1.15/Nutch-1.20-SNAPSHOT",
"NutchCVS/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; [email protected])",
"istellabot-nutch/Nutch-1.10"
]
Expand Down

0 comments on commit ac02b7a

Please sign in to comment.