Enterprise DW Lead & Head of Consulting (SA)
Bluefin Solutions
Why haven't we seen an SAP HANA vs Sybase IQ showdown?
13 Jun 2011
Business Intelligence (BI), HANA, In-Memory, Enterprise Architecture, Consumer Business
You may be surprised to see SAP HANA and Sybase IQ mentioned in the same sentence. I's certainly not something I've come across very often in SAP material or conferences, and while I can understand the reasons behind this I think it's quite unfortunate. Both of these tools fundamentally solve the same problem - they enable organisations to query massive amounts of data at impressive speed. HANA stores the data mostly in memory and IQ stores the data mostly on disc - other than that the technologies are not that different. It seems obvious based on this that between the two HANA will be the winner on performance. No arguments there.
However, other than this basic acceptance, we have very little (if any) facts to go on that will allow us to compare the two solutions. Again, based on the physical architecture it can reasonably be assumed that HANA will be more expensive than IQ - and no doubt this will be true for software costs as well. So HANA is better and IQ is cheaper. Is that it? Hardly enough information to make an investment decision on.
Big data continuum
SAP does not view these technologies as overlapping, but rather as having distinct places along a "big data continuum". This is the explanation I got from George Mathew at the recent BI4.0 launch event in Johannesburg. To clarify this he mentioned, among other things, that Sybase IQ can handle petadata-scale databases, which HANA cannot. So SAP's position is that there is a place for both of these solutions and they don't compete. This goes some way to explaining why SAP doesn't see the need to present any comparative statistics.
However, I think this is an over-simplified view of the world and that it is pretty obvious to most people that have some understanding of both solutions that there is at least some overlap. The "big data continuum" concept is also extremely vague and I haven't seen any detail of this that could help customers make investment decisions (the best summary I've seen is in a blog by Helena Schwenk). This perspective also assumes that IQ (or HANA for that matter) only comes into the picture with "big data". What about "medium data"? It doesn't take that much data to start experiencing performance problems - a 100m row dataset will do. You may not consider implementing HANA in this scenario, but should you consider IQ?
Lost opportunity
SAP has a very clear marketing objective with its HANA communication and including comparative Sybase IQ statistics may not necessarily have the desired effect. It is very clearly targeting only "big data" scenarios at the moment, and in a way I don't blame them as this makes for the most compelling stories. But it does feel like this caters for an elite group of customers only (i.e. organisations that could afford HANA). The problem is that medium sized organisations with slightly shallower pockets also have problems with performance - problems that could potentially be addressed by IQ.
HANA v IQ - why should we know?
For me it's all about understanding the options and helping customers make the right decision for them. Here are a couple of points to consider:
- SAP HANA is a brand new product on v1.0 with no production reference sites(yet) - IQ is a mature product (v15.3) with hundreds of world-wide reference sites
- SAP HANA does not yet offer Disaster Recovery or High Availability features, which IQ does
- There is not much SAP HANA skill in the market so it will be hard to come by and pricy - equivalent IQ skills will be easier to get hold of and much cheaper
- SAP HANA is likely to require more expensive hardware and have higher licence costs
It's clear that IQ has a lot going for it. However, the point of this is not show the superiority of IQ, but rather to bring some balance and reality to the HANA discussion. No doubt HANA has tremendous promise and will be a fantastic enabler in many scenarios. But it has some way to go before it is a mature product and in the mean time options like IQ deserve some consideration. Of course the missing element to the list above is the answer to the following question:
"If I pour the same large data set into HANA and IQ, how does the query performance compare between the two solutions? I.e. if HANA comes back in 0.4s, does IQ take 2s? 10s? Or 1min?"
Nobody seems to know. Or if they know they are certainly not telling. This is a situation that needs to be remedied and all it will take is an IQ installation (done) a HANA appliance (hopefully arriving soon) and some test data. Watch this space for a blog on the outcome!
Comments
bmvrus 14 Nov 2011
My personal IMHO - IQ must be faster then NANA (1.0 SP3) on the same HA, and users > 1000.
Herman Ohlhoff 15 Jun 2011
Trevor,
Good point. It seems the positioning of many of the Sybase products needs some attention. One other example I can think off is Sybase CEP relative to SAP BusinessObjects Event Insight.
Regards,
Herman
Trevor Moore 14 Jun 2011
Another thing to consider is that todays massive datastes become tomorrows medium sized and next years small!! As such I wouls also like to see HANA compared with a Sybase ASE in Memory database that has been indexed and partioned correctly.
Herman Ohlhoff 14 Jun 2011
Vitaliy,
Thanks for your response. I do not dispute that HANA and IQ have different focuses. However I do still maintain that there are scenarios where both IQ and HANA could be considered as viable solutions.
In general I feel that the positioning of these tools is articulated in vague terms and is not clear enough to support decision makers. The market can do with some real life examples showing the complimentary or contrasting scenarios for implementing IQ and/or HANA. Having some hard statistical data around performance is a critical part of this posititioning in my opinion.
Regards,
Herman
Vitaliy @Sygyzmundovych 14 Jun 2011
Thank you for sharing your thoughts.
I do not think there is an "absolute" answer, otherwise we would probably see in nature a single "absolute" animal that runs, jumps, flies and swims the fastest of all. Instead mother nature created one animal in each category for reason. Same here - HANA and IQ have been created for specific purposes, no matter how general marketing statements are.
For me it all starts with the assumption that HANA is not being built to be the fastest on the planet in the processing of big data, but is built to allow truly real-time analysis on transactional data by handling OLTP and OLAP processing workloads by one instance. IQ is being built to compete in specialized analytics market, and as such does not compete with HANA on its purpose, but with Teradatas, Verticas, Netezzas and ParAccels of this world.