What’s new in 2020.3¶
SQream DB v2020.3 contains new features, improved performance, and bug fixes.
Parquet and ORC files can now be exported to local storage, S3, and HDFS with COPY TO and foreign data wrappers.
We’ve introduced new error tolerance features when loading data with foreign data wrappers
TEXTis ramping up with new features (previously only available with VARCHARs):
New log viewer helps you track and debug what’s going on in SQream DB
Dashboard now also available for non-k8s deployments
The editor contains a new query concurrency tool for date and numeric ranges
Error handling for CSV FDW
Enable logging errors - ORC, Parquet, CSV
Add limit and offset options to csv_fdw import
Enable logging errors to an external file when skipping CSV, Parquet, and ORC errors
Option to specify date format to the CSV FDW
Support all existing Varchar functions with Text on GPU
Support INSERT INTO + ORDER BY optimization for non-clustered tables
Performance improvements with I/O
Better error message when passing the max errors limit
showFullExceptionInfo is no longer restricted to developer mode
StreamAggregateA reduction error when performing aggregation on a null column
Insert into query fails with “”Error at Sql phase during Stages “”rewriteSqlQuery”“
Cast from varchar to nvarchar doesn’t remove the spaces
Internal Runtime Error t1.size() == t2.size() when querying sqream_catalog.delete_predicates
spoolMemoryGB and limitQueryMemoryGB show incorrectly in the runtime global section of show_conf
Casting empty text to int causes illegal memory access
Copy from TEXT field is 1.5x slower than the VARCHAR equivalent
TPCDS 10TB - Internal runtime error (std::bad_alloc: out of memory) on 2020.1.0.2
Not equal join on not existing TEXT crashes the system
Internal runtime time error when using TEXT (tpcds)
Copying CSV with a quote in the middle of a field to TEXT field does not produce an error
Can’t monitor long network insert loads with SQream
Upper & like performance on Nvarchar
Insert into from 4 instances get stuck (hanging)
An invalid formatted CSV can cause an insufficient memory error on a COPY FROM statement if a quote isn’t closed and the file is much larger than system memory.
TEXT columns can’t be used with an outer join together with an inequality check (!= , <>)
Known Issues & Limitations¶
DATETIMEerrors when the
Casting an empty
TEXTfield to an
0instead of erroring
COUNT( distinct ... )operations on the
TEXTdata type are currently unsupported
COUNT( distinct ... )operations within the same query are limited to “developer mode” due to an instability that was identified. If you rely on this feature, contact your SQream account manager to enable this feature.
Upgrading to v2020.3¶
Versions are available for IBM POWER9, RedHat (CentOS) 7, Ubuntu 18.04, and other OSs via Docker.
Contact your account manager to get the latest release of SQream DB.