Python-Web-Scrapping---Search-Engine-

This is part of a search engine project. It involves scrapping through an html page or url, static or online. It elimates stopwords and gives the frequency of the search word.

How to set up the project

It this project we will use BeautifulSoup , nltk and requests which can each be installed as follows

pip install bs4

pip install requests

pip install nltk

Note: for nltk:

Open the python shell and run the following :

>>> import nltk

>>> nltk.download("stopwords")

>>> nltk.download("punkt")

You will have to specify the language in each file.

Author

Nfor Esperance