List of Resources for Crawler

• Justext by Jan Pomikalek
• Urdu Stopwords
• Pashto Stopwords

List of Languages Supported

• Punjabi
• Balochi
• Pashto
• English
• Kashmiri
• Urdu
• Dari
• Hindi
• Dogri
• Sindhi
• Shahmukhi