List of Resources for Crawler

• Justext by Jan Pomikalek
• Urdu Stopwords
• Pashto Stopwords

List of Languages Supported

• Dari
• Punjabi
• Sindhi
• Pashto
• Kashmiri
• Dogri
• English
• Hindi
• Urdu
• Balochi
• Shahmukhi