http://goo.gl/EmKxy0

Home > ASE > Data Explosion : R V Ready?

Data Explosion : R V Ready?

January 25th, 2011 Leave a comment Go to comments

We have social networking profiles like orkut, facebook, Linkedin & many more online application.

Have you relized that last 5 years how many profiles have been created ? The number is so big.

Have you relized how much data is stored behind these profiles?

In india, we started using these profile from our generation only. Think the number of user after  two generation and the amount of data due to that.

When we are making a call , when we do shopping, when we do banking, when we accessing social network site and making new profile, we are only creating data.

Do you think, in a sinlge minute how many people do the calls and how many people makes their new profile?
Every minutes we are increasing data.

What you think, we will not crosss tera-peta byte databases very soon?

We will must cross, for that do our existing technologies are capable enough? I cant say yes.

Second thing, it would be very tough to decide the obsolete data,to purge our databases. Isnt it?

We are now  started creating the data very fast, We will certainly need to enhance our technologies, may be
we need to think beyond our existing DB technologies.

Whats your thoughts?

Check the Sybase Wiki @ sybasewiki.com
Categories: ASE Tags: , , , ,
  1. February 21st, 2011 at 23:49 | #1

    See the Response from the Manish.
    Source: http://forums.sybase.com/cgi-bin/webnews.cgi?cmd=item-25840&group=sybase.public.ase.administration

    ==========================================

    NewsGroup: sybase.public.ase.administration
    Date: Jan 29,2011 03:29 am
    Created by: “Manish Negandhi [TeamSybase]”
    Topic: Re: Data Explosion : R V Ready?
    wrote in message news:4d43a732.62ae.1681692777@sybase.com…
    > Sybase/Database Experts,
    >
    > I have one thoughts, thats pinching me again and again , so
    > that I am putting in front of you.
    >
    > We have social networking profiles like orkut, facebook,
    > Linkedin,twitter & many more online application.
    >
    > Have you relized that last 5 years how many profiles have
    > been created ? The number is really big.
    >
    > Have you relized how much data is stored behind these
    > profiles?
    >
    > In india, we started using these profile from our generation
    > only. Think the number of user after two generation and the
    > amount of data due to that.
    >
    > When we are making a call , when we do shopping, when we do
    > banking, when we accessing social network site and making
    > new profile, we are only creating data.
    >
    > Do you think, in a sinlge minute how many people do the
    > calls and how many people makes their new profile?
    > Every minutes we are increasing data.
    >
    >
    > What you think, we will not crosss tera-peta byte databases
    > very soon?
    >
    > We will must cross, for that do our existing technologies
    > are capable enough? I cant say yes.
    >
    > Second thing, it would be very tough to decide the obsolete
    > data,to purge our databases in these cases. Isnt it?
    >
    > I think, We need to redefine or backup technology, data
    > accessing technology for these lasrge datamarts? Isn’t it?
    > May be we need to think beyond our existing DB technologies.
    >
    > Whats your thoughts?

    Good points. Absolutely, data is growing by leaps and bounds. Humans are
    generating more data than before and machines also generating lot more data
    than before
    We are already in petabytes age , social networking sites like facebook,
    orkut and others like amazon are generating huge amount of data. Increasing
    amount of data is one of the reasons why most RDBMS vendors are gearing up
    to embrace new functionalities like Hadoop, map-reduce in traditional rdms.
    Here are some pointers for this

    http://iablog.sybase.com/paulley/2008/11/hadoop-vs-relational-databases/
    http://www.computerworld.com/s/article/9142333/Sybase_is_latest_RDB_maker_to_embrace_MapReduce?taxonomyId=9&pageNumber=1

    > Second thing, it would be very tough to decide the obsolete
    > data,to purge our databases in these cases. Isnt it?

    At the same time “one size fits” approach is not good enough i.e. if one
    wants to setup very large datamarts or warehouse, one should be looking for
    DW products like IQ not ASE
    Purging the data is directly related to business requirements, while OLTP
    systems might need few years of data, business might want to retain data in
    datawarehouse for decades
    therefore data in OLTP systems can be periodically purged easily. Also
    replication technologies like High Volume Adaptive Replication (HVAR) are
    being developed to deliver data from ASE to Sybase IQ and through
    continuous change data capture (CDC) technology in order to cope up with
    demand of real-time analytics

    -HTH
    Manish Negandhi
    [TeamSybase]
    ===========================================================

  1. No trackbacks yet.