What programming language would I use if I want to write a robot that is able to visit regular webpages and extract and collect information from them? Some examples would be to find out what days a hotel (that doesn't have a calendar view) offers the cheapest stays, go inside several threads on forum and collect all text (so I can search for specific key words), or collect pictures from an advertising website so I can see the items quickly without having to click on each ad. So, the robot needs to be able click on buttons/links, change comboxes, etc as well as collecting the information in the webpage. What IDE would I use, can I use Visual Studio?
Noting of course that I would suspect that you will find that there are already a number of libraries out there that do most of that.
So deciding what features you need, both for the scanner and for the rest of your application, and THEN go look for a library and other technologies to match that would be best.
And in general this sort of question is almost always answered by "the one you have the most familarity with." Because creating a brand new system with all brand new technologies might be fun but it is not the best way successfully create such a system nor to create one that actually makes money.
I would like to develop a CAD-like GUI for microelectronics.
My first problem is how to design the main screen. Like any software of this kind, you have simply a background where you can put objects. Usually, this background is black or white, it has a grid and you can zoom in/out. (Please check any spice simulator)
Initially, I thought of using some kind of language from Microsoft Visual Studio suite. It allows to do forms, menus, buttons, etc, but it would be slow after adding all the functionalities (I guess).
What's the best programming language and graphical engine to do this?
Well I am an old guy and have been programming for ages. The language is not really my problem. What I don't know is how to do graphics programming using an engine and which are the languages that will result in a fast piece of software.
I would like to develop a CAD-like GUI for microelectronics....but it would be slow after adding all the functionalities (I guess).
If you really mean that then no it is not going to be slow. There are hundreds if not thousands of specialized IDEs that are developed in a variety of languages.
If you want examples in one specific category google for "UML design tools".
Note that if you want to simulate, which is not the same as design, then that has nothing to do with the UI but has to do with creating a simulation engine. That could be slow depending on what you want to do. But that is design/requirements problem not a language problem.
What I want to do is simple (at least in concept ).
I would like to have a background (canvas) where I could draw lines only ( I just need lines), just like in any drawing program, but the lines will be only either horizontal or vertical.
In visio, for example, you can have objects and connect them with lines to their vertices. This is a very important feature to me and that I would like to have.
Based on my requirements I have narrowed down the development to be done either in Visual C# or C++ and Qt.