Some parts of a webpage is empty when try to scrap

I’m trying to scrap a web page: http://www.rrk.ir/News/ShowNews.aspx?Code=12099110 as you see it contains some Persian characters. I tried to do it with both urllib2 and requests modules of Python. But the problem is that the main part of the html code is empty in the result. This part is exactly after <div class="Jus" style="font-family: Tahoma !important;"> which is in Persian. Is it because of the website security? and how it can be solved? My code to do so is:

r = requests.get('http://www.rrk.ir/News/ShowNews.aspx?Code=12099110')
result = r.text.encode("utf-8")
print result


Source: python

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.