Selenium Scraping Javascript

I'm planning on making a website that scrapes a lot of daily updated URLS (JavaScript) from many websites. I did some research and found selenium, already made some code to extract

Solution 1:

If you really want to make a scraper i recommend you to use Beautiful soup, which is a Python library for pulling data out of HTML and XML files. you can integrate the python script with django which can be triggered on a click. following is the link.

https://pypi.python.org/pypi/beautifulsoup4