Release Notes 2020.3¶
The 2020.3 release notes were released on October 8, 2020 and describes the following:
The following list describes the new features:
Parquet and ORC files can now be exported to local storage, S3, and HDFS with COPY TO and foreign data wrappers.
New error tolerance features when loading data with foreign data wrappers.
TEXTis ramping up with new features (previously only available with VARCHARs):
New log viewer helps you track and debug what’s going on in SQream DB.
Dashboard now also available for non-k8s deployments.
The editor contains a new query concurrency tool for date and numeric ranges.
The following list describes the performance enhancements:
Error handling for CSV FDW.
Enable logging errors - ORC, Parquet, CSV.
Add limit and offset options to
Enable logging errors to an external file when skipping CSV, Parquet, and ORC errors.
Option to specify date format to the CSV FDW.
Support all existing
ORDER BYoptimization for non-clustered tables.
Performance improvements with I/O.
The following list describes the resolved issues:
Better error message when passing the max errors limit. This was fixed.
showFullExceptionInfois no longer restricted to Developer Mode. This was fixed.
StreamAggregateAreduction error occured when performing aggregation on a
NULLcolumn. This was fixed.
Insert into query fails with “”Error at Sql phase during Stages “”rewriteSqlQuery””. This was fixed.
TEXTdoes not remove the spaces. This was fixed.
Internal Runtime Error t1.size() == t2.size()occurs when querying the
sqream_catalog.delete_predicates. This was fixed.
limitQueryMemoryGBshow incorrectly in the runtime global section of
show_conf.This was fixed.
Casting empty text to
intcauses illegal memory access. This was fixed.
Copying from the
TEXTfield is 1.5x slower than the
VARCHARequivalent. This was fixed.
TPCDS 10TB - Internal runtime error (std::bad_alloc: out of memory)occurs on 2020.1.0.2. This was fixed.
An unequal join on non-existing
TEXTcaused a system crash. This was fixed.
Internal runtime time erroroccured when using
TEXT (tpcds). This was fixed.
Copying CSV with a quote in the middle of a field to a
TEXTfield does not produce the required error. This was fixed.
Cannot monitor long network insert loads with SQream. This was fixed.
Upper and like performance on
TEXT. This was fixed.
Insert into from 4 instances would get stuck (hanging). This was fixed.
An invalid formatted CSV would cause an insufficient memory error on a
COPY FROMstatement if a quote was not closed and the file was much larger than system memory. This was fixed.
TEXTcolumns cannot be used with an outer join together with an inequality check (!= , <>). This was fixed.
The following list describes the known issues and limitations:
DATETIMEerrors when the
Casting an empty
TEXTfield to an
0instead of erroring
COUNT( distinct ... )operations on the
TEXTdata type are currently unsupported
COUNT( distinct ... )operations within the same query are limited to “developer mode” due to an instability that was identified. If you rely on this feature, contact your SQream account manager to enable this feature.