Submitting offline forms using python

Question

0.00/5 (No votes)

See more:

I am trying to extract information from my college website using python. Here is the link of the website.

http://studzone.psgtech.edu/CommonPage.aspx

I have the exam results page locally saved. I want to know how to submit data using the local file and get the resulting page using python. I've looked into urllib2, requests, mechanize frameworks. But haven't got any useful information on submitting data from a local HTML file. Thanks in advance.

I've use following code to obtain the web page and store it in a object. Is there anyway to post the form in that webpage stored in the page variable? I can edit the field such that value="something".

Python

import urllib2
import requests

page = urllib2.urlopen("http://google.com/").read()
c = requests.post(page, data) #is something like this possible?

Posted 25-Sep-15 7:48am

Ashwin2013

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

**Zoltán Zörgő** · Answer 1 · 2015-09-25T10:40:00

Solution 1

Of course. See:
https://docs.python.org/2/howto/urllib2.html[^]
or
https://docs.python.org/2/library/httplib.html[^]

Look for POST related sections...
Still, before you can do this, you might need to investigate http traffic. You might need to mimic more browser action, than just posting. You might need to add session state, log in, and so on. Fiddler[^] is a good tool to start with.

Posted 25-Sep-15 10:40am

Zoltán Zörgő

Comments

Ashwin2013 29-Sep-15 14:13pm

I used urllib2 and requests in combination to accomplish the task. Thanks anyway.

requests contains library to parse local html and page can be retrieved using urllib2 and requests while requests have more control with setting cookies and sessions. Use it wisely.