Hi, we created a table with
max_rows. We want the table to reach 10 million rows. And then, when new data is loaded, the oldest data (some data from the end of the table) will pop out. The total rows should be 10 million rows. We create the table by,
Create table IF NOT EXISTS geotweets (message_id BIGINT,tweet_date TIMESTAMP(0),tweet_text TEXT ENCODING NONE, tweet_lang TEXT ENCODING DICT(32), latitude DOUBLE,longitude DOUBLE,sentiment_score DOUBLE) WITH (max_rows = 10000000);
We try to load data to this table every day by pymapd,
But this way. we found out that when the data will exceeds 10 million, the next upload of data to the database will directly cause some data loss, instead of directly deleting the oldest data and keeping the table with 10 million rows.
Is there anything we did wrong here? Any suggestion for implementing our objective here with Heavydb itself?
Please sign in to leave a comment.