|
You have to manipulate ALL of those 100 million records every hour?
Or is it just some, and then what percentage?
And what kind of reporting do you need to do? On how many records?
Fact is that it's not so important which DB you're having as long as you're just doing CRUD.
The size of the database is also not very important for the performance (Were talking about a factor of a couple of hundred times larger for every new level in an index, assuming B-Tree index).
It's the number of transactions! And how many records that are affected by the queries.
So the limiting factors will be the hardware (mostly the harddrives), the configuration of the hardware (It doesn't matter if the drives are fast if they're in a RAID5), and the indexes.
If you have no indexes at all, all inserts will be ridiculously fast, but querying or updating will be just as ridiculously slow.
Adding every index you can think about will make both inserts and updates ridiculously slow instead, while the queries will be faster.
Note that updates needs to both read and write.
Finding the right indexes will give you a good balance.
|
|
|
|
|
"Manipulate" 100 million records per hour?
Ask Amazon or Google to host your data.
Bastard Programmer from Hell 
If you can't read my code, try converting it here[^]
|
|
|
|
|
sir, in this context i used "manipulate" for "searching"
|
|
|
|
|
Then you are using the wrong terms. "Manipulate" means updating, inserting or deleting records. Reading doesn't manipulate the data, it fetches it. Selecting a few million should be doable, depending on the hardware and software-combination and the skillset of the dba.
Bastard Programmer from Hell
If you can't read my code, try converting it here[^]
|
|
|
|
|
sorry, for all this.i have corrected my reply.
|
|
|
|
|
Databases are optimized to work with records; there will be a HUGE difference between searching records (select using a where) and searching a specific substring within a NTEXT field.
If you are going to search within the contents of the fiels, you'd be wanting a full-text search catalog. Again, supported by most major databases, but their speed may vary wildly.
Can you post a schema of the data that you'll be storing? Should I be thinking about simple data like measurements or prices? (lots o' fields with numbers) Or more toward text? (lots of short readable text-fields, like profiles), more toward memo's (single large textfield), or even documents (Word, PDF?)
In the case of documents I'd suggest to dump the files in the filesystem - and to use something like Google Desktop Search to search for specific terms.
Agent_Spock wrote: sorry, for all this
Don't be; for someone who doesn't code all those things might sound roughly the same. Sorry for my short and blunt answers.
Live long and prosper 
|
|
|
|
|
no sir, it consists of data which is converted into bytes.
|
|
|
|
|
Everything that a computer stores is encoded in bytes; images, text, applications - they're all stored as bytes. Hence, the remark that it's going to store bytes is not very helpfull. That way I'd assume a large binary blob, and "searching" to be a series of bytes.
Those bytes represent something; data, in whatever form. What "kind" of data you're going to store determines the best approach.
Bastard Programmer from Hell
If you can't read my code, try converting it here[^]
|
|
|
|
|
no i am using it in such way that each record has max. 25 letters
|
|
|
|
|
Then your search terms are "Free Text Search" and the name of your database
It's described for SQL Server here[^], or you could google for Lucene.NET.
Bastard Programmer from Hell
If you can't read my code, try converting it here[^]
|
|
|
|
|
I have two table such as table1 and table2
using sql joining query i have fetched or shown some desired result
but for good looking i want to create some extra user defined columns, which i can't create...
Please help as early as possible...
|
|
|
|
|
Hi,
I'm not sure what are you trying to do... Maybe you could give some example?
|
|
|
|
|
In your query you include the calculation and give the result a name, it is then treated as a column in your result set.
Select Town, Region + ' ' + State as Place
from TableName
This will create a column called Place in your result set.
Never underestimate the power of human stupidity
RAH
|
|
|
|
|
First Create a new table with using select command and then you can fatch data from those tables. And after that you can add any column in new table.
|
|
|
|
|
I have a table named as depot_mstr having attributes, are the following---
regn,
depot_code,
depot_name,
city
I have also an another table as dealer_list having attributes, are the following---
depot_no,
depot_code,
dealer_name,
dealer_category
how i get the output as---
regn| depot_code| dealer_name| GC| SC| STA| OTH
where,
GC, SC, STA, OTH are the elements of dealer_category
|
|
|
|
|
Assuming you are using sql server:
SELECT regn, depot_code, dealer_name, GC, SC, STA, OTH
FROM
(SELECT regn, depot_mstr.depot_code, dealer_name, dealer_category FROM depot_mstr LEFT
JOIN dealer_list ON depot_mstr.depot_code = dealer_list.depot_code
) AS sourcetable
PIVOT
(
COUNT (dealer_category)
FOR dealer_category IN
(GC, SC, STA, OTH)
) AS pivottable
|
|
|
|
|
Please also send me the code as early as possible, if i solve it through function in sql server...
Thank u...
|
|
|
|
|
I can't find any case using in the query....!!!
|
|
|
|
|
Hi,
I am planning to move my existing client database from MySQl to Oracle.
I will go for Express (because it's FREE)
I want to ask is the 11 GB Express is proving enough? I mean is it just 11 GB for my data or includes database sys data the it will be easily full?
please advise...
Technology News @ www.JassimRahma.com
|
|
|
|
|
|
|
Did you notice that is not the Express edition? But in either case the documentation provides the information you are looking for.
Veni, vidi, abiit domum
|
|
|
|
|
it is Express Edition.
Oracle Database Express Edition at the top and it's FREE and limited to 11 GB..!
It's confusing now..!
Technology News @ www.JassimRahma.com
|
|
|
|
|
From version 11g2 it's 11GB, before that it's 4GB.
|
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
