Kylin master 分支 2019-04月到06月新的功能和bug fix列表
https://github.com/apache/kylin

一、Feature

• Calculate column cardinality by using spark engine KYLIN-4035
  load table时计算各列的基数可以选择性的使用Spark引擎

#配置文件中添加如下配置启用
kylin.engin.spark-cardinality=true

• Add a health check job of Kylin KYLIN-3997
  检查JOB 集群健康情况
• Invalid replica set cache after status updated KYLIN-3933
• make kylin.query.enable-dynamic-column default true KYLIN-3999
• Speed up startup progress using cached dependency KYLIN-4028 每次重启都会检查HIVE/HBASE等dependency，改为只有第一次启用时加载，后续都读缓存方式，这个启动会快不少
• KYLIN-4049 Make storage clean configurable for refreshing job KYLIN-4049
• KYLIN-4032 return timestamp and date without timezone in jdbc KYLIN-4032 需要测试下，是否影响现在的JDBC查询或者页面查询的格式
• Optimize sub-path check of ResourceTool KYLIN-3271
• MrHive-Dict support build by livy KYLIN-3958
• Allow user-specified time format using real-time KYLIN-4001
• KafkaConfigOverride to take effect KYLIN-3932
• No cube for AVG measure after include count column KYLIN-3946
• Set cubing job priority KYLIN-3892
• Support cube level mapreduce queue config for BeelineHiveClient KYLIN-3912

二、Bug fix

• StorageCleanupJob may delete cube id data of new built segment because of cube cache in CubeManager KYLIN-3994

• Build engine get zk(zookeeper) lock failed when building job, this causes the whole build engine doesn’t work KYLIN-4017

• Improve cube size estimation for TOPN, COUNT DISTINCT KYLIN-3926

• fix_length rowkey encode without sepecified length can be saved but cause CreateHTable step failed KYLIN-4020
  设置fix_length时可以不配置长度并且能够保存成功，但是在build createHTable时又无法成功

• Support pushdown to presto KYLIN-4024

• Rea-time OLAP don’t support multi-level json event KYLIN-3942

• Fix Logger of HCreateTableJob record error message KYLIN-4054
  修复HCreateTableJob日志打印格式错误的问题

• upgrade curator dependency version KYLIN-4044
  CuratorScheduler may throw NPE when init service Cache，由于zk的一个问题可能报NPE的异常4044，建议升级curator到4.0以上版本

• CONCAT NULL not working properly KYLIN-4041
  concat(col1,col2)如果有一列为NULL则返回NULL

• ResourceStore deleteResource by comparing timestamp may be failed KYLIN-4030
  清理数据比对时间时运行有【0-999ms】的精度误差

• Can not access Kerberized Cluster with DebugTomcat KYLIN-4033

• Fix too many posted messages on system page with same text KYLIN-4042

• Kylin build cube error at the “Build UHC Dictionary” step KYLIN-4015

• solve the problem that kylin build error in stream build task KYLIN-3845

• Check for “ORDER BY LIMIT” clause when rewrite SUM query as TOPN KYLIN-2620

• Add detail exception in kylin http response KYLIN-4025

• Add validation for the encoding length and the type of encoding
  KYLIN-3893

• Cube planner cuboid id error when dimensions too many KYLIN-3980

• Aviod mistaken deleting dicts by storage cleanup while building jobs are running KYLIN-3977

• InternalErrorException: null with precise count distinct KYLIN-3978

• Make “bpus-min-benefit-ratio” configurable in cube planner phase 1 KYLIN-3998

• add config for sqoop config null-string and null-non-string KYLIN-3934

• optimize the child CompareTupleFilter in a CompareTupleFilter KYLIN-3812\3813

• config data type may make oom KYLIN-3995
  getTrieDictionaryForestMaxTrieSizeMB() data type is int ，however in TrieDictionaryForestBuilder “maxTrieTreeSizeMB * 1024 * 1024”

• MR/Spark task will still run after the job is stopped KYLIN-3936

• Only update user when login in LDAP environment KYLIN-3960

• Disable quote when needed KYLIN-3857

• Fix exception cannot cast ‘java.math.BigDecimal’ to 'java.lang.Double KYLIN-3957