Click here to Skip to main content
Rate this: bad
good
Please Sign up or sign in to vote.
See more: JavaHelp
I have been inserted about 15 millions of rows and 32 columns in hbase table through Map-reduce program
key-valued data eg : company= ibm ! employee= sw 
... in hbase it's look like as
row =1 column = f1: company time stamp=1123344456 value =ibm 
And while i fired the query
scan 'sample_names', {COLUMNS=>"f1:company", FILTER=>SingleColumnValueFilter.new(Bytes.toBytes('f1'), Bytes.toBytes('company'), CompareFilter::CompareOp.valueOf('EQUAL'), SubstringComparator.new("ibm")) }
 
it took about 360.09 seconds to fetch the data ,
 
can u please any one tell me how to improve the hbase query performance ?
can we reduce this query time by secondary indexing if Yes ! please suggest me how to add indexing for particular column qualifier ?
 
Thanks in Advance Smile | :)
 
[Torsten]Structure! You needed some here![/Torsten]
Posted 9-Jan-13 3:15am
Edited 9-Jan-13 3:25am
TorstenH.31.9K
v2
Comments
TorstenH. at 9-Jan-13 9:27am
   
Did I get that right - you have 15 million data sets in that table with each 32 columns??? why Can't you structure the DB?
Madhusudhana_reddy at 9-Jan-13 12:21pm
   
Yep ! have the 15 millions of data sets with each 32 columns , can u please tell me to structure the DB ? bye the way is that way of inserting data also matters or wat while we are fetching the data from tables ?... please suggest me ... Thanx for ur quick feed back :) :)
Madhusudhana_reddy at 10-Jan-13 13:10pm
   
what would be best query time for the 5 million records in hbase , like when i ran the single columnvalue filter query for the evendate = 01/5/2010 , it gave about ** 36 records out of 5 million records, and taken 154.09 seconds **, so please suggest me to improve the query performance :) .....

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
Your Filters
Interested
Ignored
     
0 Sergey Alexandrovich Kryukov 397
1 OriginalGriff 350
2 thatraja 205
3 Emre Ataseven 165
4 Shai Vashdi 150
0 Sergey Alexandrovich Kryukov 8,894
1 OriginalGriff 5,200
2 Peter Leow 3,955
3 Maciej Los 3,535
4 Abhinav S 3,208


Advertise | Privacy | Mobile
Web02 | 2.8.140415.2 | Last Updated 9 Jan 2013
Copyright © CodeProject, 1999-2014
All Rights Reserved. Terms of Use
Layout: fixed | fluid