How to Search the Parse Tree using BeautifulSoup?

Searching the parse tree means we need to find the tag and the content of the HTML tree. This can be done in many ways. But the most used method for searching the parse tree is the find() and find_all() method. With the help of this, we can parse the HTML tree using Beautifulsoup.

For Searching the parse tree follow the below steps.

Step 1: For scraping, we need to import the beautifulsoup module and import the requests method to request the website page.

from bs4 import BeautifulSoup
import requests

Step 2: The Second step will be to create a soup of the website or HTML page with the HTML parser and beautifulsoup function.

BeautifulSoup(sample_website, 'html.parser')

Step 3: We can search the parse tree with two methods in soup first is find method and the second is find all method. In the find method, it will return the first HTML tree which will satisfy the condition and find_all method will return all the HTML parse tree which will satisfy the condition.

Example 1: Using the find() method

from bs4 import BeautifulSoup
import requests


# sample website
sample_website = 'https://www.geeksforgeeks.org/difference-between-article-and-blog/'

# call get method to request the page
page = requests.get(sample_website)

# with the help of BeautifulSoup method and
# html parser created soup
soup = BeautifulSoup(page.content, 'html.parser')

# With the help of find method perform searching 
# in parser tree
print(soup.find('th'))

Output:

<th>S.No.</th>

Example 2: Using find_all() method

from bs4 import BeautifulSoup
import requests


# sample website
sample_website = 'https://www.geeksforgeeks.org/difference-between-article-and-blog/'

# call get method to request the page
page = requests.get(sample_website)

# with the help of BeautifulSoup method and html
# parser created soup
soup = BeautifulSoup(page.content, 'html.parser')

# With the help of find_all method perform searching
# in parser tree
print(soup.find_all('th'))

Output:

 [<th>S.No.</th>, <th>ARTICLE</th>, <th>BLOG</th>]

vipinyadav15799

Follow

Improve

Article Tags :

• Python
• Python BeautifulSoup
• Python bs4-Exercises

Practice Tags :

• python