List of Resources for Crawler

• Justext by Jan Pomikalek
• Urdu Stopwords
• Pashto Stopwords

List of Languages Supported

• Dari
• Pashto
• Hindi
• English
• Punjabi
• Sindhi
• Shahmukhi
• Kashmiri
• Urdu
• Balochi
• Dogri