Is It Possible To Get The Raw Text Of A Webpage Post Js In Python
I've tried using: html = requests.get(my_website).text soup = BeautifulSoup(html) print soup.get_text() But the issue that I run into is that Javascript isn't getting rendered.
Solution 1:
JavaScript is not automatically rendered using BeautifulSoup. You may want to try tools like Selenium
, Mechanize
, PhantomJs
with BeautifulSoup to render JavaScript. Dryscrape is also a good tool to look into.
Post a Comment for "Is It Possible To Get The Raw Text Of A Webpage Post Js In Python"