Click here to Skip to main content
15,851,335 members
Please Sign up or sign in to vote.
1.00/5 (1 vote)
See more:
Hello

I am using Selenium in c# to scrap the data from a site.I am just new in selenium. I have created a console app for that. But I need to implement this scrapper functionality on the main website so that website's admin can scrape the data as per his requirement or any time interval when he is required.I am using asp .net web api at the back end in the main website.Now I am trying to execute the console exe to scrape from web api.

Could you please help me with this? What is the best way to do this and what would you recommend for this requirement?

Thanks
Vikas

What I have tried:

I have created a console app for that. But I need to implement this scrapper functionality on the main website so that website's admin can scrape the data as per his requirement or any time interval when he is required.I am using asp .net web api at the back end in the main website.Now I am trying to execute the console exe to scrape from web api.I just want to know about what is best way to do this?
Posted
Updated 15-Mar-18 5:28am
Comments
F-ES Sitecore 15-Mar-18 9:34am    
I can't see any ethical reason you would be doing this.
Richard MacCutchan 15-Mar-18 10:03am    
Why would the website's administrator need to use a web scraper?

1 solution

You shouldn't be executing external applications from a web site (security concerns).

Either move the necessary code from the console app to the web app, or reference the console app assembly in your web app and use the code as is.
 
Share this answer
 

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900