加入收藏 | 设为首页 | 会员中心 | 我要投稿 李大同 (https://www.lidatong.com.cn/)- 科技、建站、经验、云计算、5G、大数据,站长网!
当前位置: 首页 > 大数据 > 正文

使用elasticdump做数据迁移

发布时间:2020-12-14 04:39:29 所属栏目:大数据 来源:网络整理
导读:es版本 [[email?protected] bin]# ./elasticdump --help elasticdump: Import and export tools for elasticsearch version: 4.6.0 1. elasticdump 安装 su - root cd /opt yum install epel-release yum install nodejs yum install npm npm install elasti


es版本
[[email?protected] bin]# ./elasticdump --help
elasticdump: Import and export tools for elasticsearch
version: 4.6.0

1.elasticdump

安装
su - root
cd /opt
yum install epel-release
yum install nodejs
yum install npm
npm install elasticdump
cd node_modules/elasticdump/bin? 后便可以执行操作。

#拷贝analyzer如分词
./elasticdump
? --input=http://192.168.1.85:9200/db_customer
? --output=http://192.168.1.118:9200/db_customer
? --type=analyzer

#拷贝映射
./elasticdump
? --input=http://192.168.1.85:9200/db_customer
? --output=http://192.168.1.118:9200/db_customer
? --type=mapping

#拷贝数据
./elasticdump
? --input=http://192.168.1.85:9200/db_customer
? --output=http://192.168.1.118:9200/db_customer
? --type=data


------------------------原封不动的迁移----------------------------------------------
#拷贝分词
./elasticdump --input=http://192.168.1.136:19200/hxl_test --output=http://192.168.1.136:19200/bak01_hxl_test --type=analyzer


#拷贝映射
./elasticdump --input=http://192.168.1.136:19200/hxl_test? --output=http://192.168.1.136:19200/bak01_hxl_test --type=mapping


#拷贝数据
./elasticdump --input=http://192.168.1.136:19200/hxl_test --output=http://192.168.1.136:19200/bak01_hxl_test --type=data

----------------------------提前创建索引后,只迁移数据------------------------
1.提前创建索引,结构可以跟源库的有一定的差异
比如在原来索引的基础上添加了"type": "nested"
2.同步数据
/opt/node_modules/elasticdump/bin/elasticdump --input=http://192.168.1.136:19200/inoculate --output=http://192.168.1.136:19200/inoculate_new --type=data
?
?遇到的错误:
?/opt/node_modules/elasticdump/lib/processor.js:40
? async _loop (limit,offset,totalWrites) {
??????? ^^^^^

SyntaxError: Unexpected identifier
??? at createScript (vm.js:56:10)
??? at Object.runInThisContext (vm.js:97:10)
??? at Module._compile (module.js:549:28)
??? at Object.Module._extensions..js (module.js:586:10)
??? at Module.load (module.js:494:32)
??? at tryModuleLoad (module.js:453:12)
??? at Function.Module._load (module.js:445:3)
??? at Module.require (module.js:504:17)
??? at require (internal/module.js:20:19)
??? at Object.<anonymous> (/opt/node_modules/elasticdump/elasticdump.js:3:28)
[[email?protected] bin]#
[[email?protected] bin]# npm install -g n
/usr/bin/n -> /usr/lib/node_modules/n/bin/n
/usr/lib
└── [email?protected]

[[email?protected] bin]# /opt/node_modules/elasticdump/bin/elasticdump --input=http://172.17.10.20:19200/child_inocexamine_student --output=http://172.17.10.61:29200/child_inocexamine_student --type=analyzer
/opt/node_modules/elasticdump/lib/processor.js:40
? async _loop (limit,totalWrites) {
??????? ^^^^^

SyntaxError: Unexpected identifier
??? at createScript (vm.js:56:10)
??? at Object.runInThisContext (vm.js:97:10)
??? at Module._compile (module.js:549:28)
??? at Object.Module._extensions..js (module.js:586:10)
??? at Module.load (module.js:494:32)
??? at tryModuleLoad (module.js:453:12)
??? at Function.Module._load (module.js:445:3)
??? at Module.require (module.js:504:17)
??? at require (internal/module.js:20:19)
??? at Object.<anonymous> (/opt/node_modules/elasticdump/elasticdump.js:3:28)
?? ?
解决办法:
#升级nodejs
[[email?protected] ~]# npm install -g n
[[email?protected] ~]# n latest

(编辑:李大同)

【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容!

    推荐文章
      热点阅读