List of Resources for Crawler

• Justext by Jan Pomikalek
• Urdu Stopwords
• Pashto Stopwords

List of Languages Supported

• Hindi
• Kashmiri
• Sindhi
• Balochi
• Urdu
• Pashto
• Shahmukhi
• Punjabi
• English
• Dari
• Dogri