2019-10-16

Clickhouse物化视图

Clickhouse创建物化视图，指定POPULATE

CREATE MATERIALIZED VIEW app.tracker_log (`day` Date, `st` UInt64, `u_i` String, `d_i` String, `tk_id` String, `time` DateTime, `cat` String, `act` String, `e_t` String, `c_p` String) ENGINE = MergeTree()  PARTITION BY day ORDER BY (st) POPULATE AS SELECT day, toUInt64(s_t) AS st, u_i, d_i, tk_id, toDateTime(toUInt64(st) / 1000) AS time, cat, act, e_t, multiIf((c_p = 'iOS') OR (c_p = 'IOS') OR (c_p = 'Android'), 'APP', (c_p = 'wap') OR (c_p = 'WAP'), 'WAP', 'PC') AS c_p FROM app.scene_tracker WHERE (s_t != '') AND ((u_i != '') OR (d_i != '')) AND (length(d_i) > 5) AND (length(cat) > 1) AND (length(act) > 1)

2019-10-11

编程

WaterDrop将Kafka中的数据写入Clickhouse

下载并解压WaterDrop

1	wget https://github.com/InterestingLab/waterdrop/releases/download/v1.4.1/waterdrop-1.4.1.zip

修改配置文件waterdrop-env.sh

1
2
3

cd /data/work/waterdrop-1.4.1
vim config/waterdrop-env.sh
SPARK_HOME=/data/work/spark-2.4  #配置为spark的路径

2019-10-11

编程

Elasticsearch按照时间统计文档数量

Elasticsearch按时间聚合

2019-10-09

编程

Linux History 提示自动补全

软件安装参考 https://github.com/dvorka/hstr

1 2	sudo yum install -y hstr hstr --show-configuration >> /etc/profile

之后记得使命令生效

1	source /etc/profile

在命令行收入hstr，就会出现命令history，If you want to make running of hstr from command line even easier, then define alias in your ~/.bashrc:

1	alias hh=hstr

Don’t forget to source ~/.bashrc to be able to to use hh command.

其它：
使用root用户执行

sudo yum install -y hstr
hstr --show-configuration >> /etc/profile
echo "alias hh=hstr" >> /etc/profile
source /etc/profile

2019-10-09

编程

为Clickhouse增加自定义函数

在/data/apps/clickhouse-source/ClickHouse/dbms/src/AggregateFunctions目录下创建两个文件AggregateFunctionSequenceMatch1.h和AggregateFunctionSequenceMatch1.cpp

2019-09-17

Centos7编译Clickhouse

参考 https://clickhouse.yandex/docs/en/development/build/

安装GCC7

查看现在的版本

[root@hadoop3 ~]# gcc --version
gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

2019-09-15

编程

Xcode Failed to Create Provisioning Profile.

在使用xcode创建新项目时，有可能会出现以下的错误

Failed to create provisioning profile.
The app ID "com.hohode.Cal" cannot be registered to your development team. Change your bundle identifier to a unique string to try again.

No profiles for 'com.hohode.Cal' were found
Xcode couldn't find any iOS App Development provisioning profiles matching 'com.hohode.Calculator'.