Click here to Skip to main content
15,744,149 members
Please Sign up or sign in to vote.
0.00/5 (No votes)
See more:
I created a forloop in order to extract the variables from a website, but when I run the code I am not getting what I wanted to print. How do I fix this error?

What I have tried:

from bs4 import BeautifulSoup
import requests

url= ""
page = requests.get(url)

soup = BeautifulSoup(page.content, 'html.parser')
lists = soup.find_all('section', class_="container")

for list in lists:
    accId = lists.find('data-account-id', class_="account-card card")
    ttlDue = lists.find('data-total-due', class_="account-card card")
    taxNum = lists.find('data-tax-number', class_="account-card card")
    pstAmt = lists.find('true', class_="account-card card")
    info = [accId, ttlDue, taxNum, pstAmt]

<Response [200]>

Process finished with exit code 0
Updated 2-Jan-23 17:47pm
Sandeep Mewara 2-Jan-23 23:43pm    
Your code looks fine to me.

The exit code of 0 means that the process has been executed and exited successfully. This means no error was encountered.

Did you debug and see that you hit the for loop? My guess is there is nothing in the lists variable to loop through.
Richard MacCutchan 3-Jan-23 5:00am    
Most likely none of the items you are searching for exist in the returned HTML. So check the actual content to make sure.

1 solution

Getting your code to run at all does not mean it is right! :laugh:
Think of the development process as writing an email: compiling successfully means that you wrote the email in the right language - English, rather than German for example - not that the email contained the message you wanted to send.

So now you enter the second stage of development (in reality it's the fourth or fifth, but you'll come to the earlier stages later): Testing and Debugging.

Start by looking at what it does do, and how that differs from what you wanted. This is important, because it give you information as to why it's doing it. For example, if a program is intended to let the user enter a number and it doubles it and prints the answer, then if the input / output was like this:
Input   Expected output    Actual output
  1            2                 1
  2            4                 4
  3            6                 9
  4            8                16
Then it's fairly obvious that the problem is with the bit which doubles it - it's not adding itself to itself, or multiplying it by 2, it's multiplying it by itself and returning the square of the input.
So with that, you can look at the code and it's obvious that it's somewhere here:
int Double(int value)
   return value * value;

Once you have an idea what might be going wrong, start using the debugger to find out why. Put a breakpoint on the first line of the method, and run your app. When it reaches the breakpoint, the debugger will stop, and hand control over to you. You can now run your code line-by-line (called "single stepping") and look at (or even change) variable contents as necessary (heck, you can even change the code and try again if you need to).
Think about what each line in the code should do before you execute it, and compare that to what it actually did when you use the "Step over" button to execute each line in turn. Did it do what you expect? If so, move on to the next line.
If not, why not? How does it differ?
Hopefully, that should help you locate which part of that code has a problem, and what the problem is.
This is a skill, and it's one which is well worth developing as it helps you in the real world as well as in development. And like all skills, it only improves by use!
Share this answer

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900