List of Resources for Crawler

• Justext by Jan Pomikalek
• Urdu Stopwords
• Pashto Stopwords

List of Languages Supported

• Kashmiri
• Punjabi
• Hindi
• Pashto
• Dari
• English
• Balochi
• Sindhi
• Urdu
• Shahmukhi
• Dogri