Click here to Skip to main content
15,887,214 members
Please Sign up or sign in to vote.
0.00/5 (No votes)
See more:
So there is a website which contains some information. I am building an Android app that will show some specific information of that website and whenever the website gets some update, my app will automatically receive a notification about that update, and also UI gets updated.

What I have tried:

I am thinking of a method to scrape that website and store that data in Firebase, then load that data from Firebase to the Android app. I will set some automatic method to scrape continuously after some interval and update that data to Firebase and use FCM to send notifications to apps.

I am asking if this is the right way or if there is another simpler way to do so. Any high-level approach is appreciated.

And yes, I have permission to scrap that website.
Posted
Updated 5-Nov-23 0:33am
v3
Comments
Dave Kreskowiak 29-Oct-23 11:34am    
How is your app getting notified the website got some update?

Web scraping is a weapon of last resort. ALWAYS go for any API the site may expose before you ever consider scraping a website.
David Crow 30-Oct-23 10:54am    
If your app is not in the foreground, scraping data from a web site is pointless. Do that when your app opens. If the data on that web site changes frequently enough, and your app could remain in the foreground long enough (studies show that most don't), you could set a refresh timer.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900