130 Commits

Author SHA1 Message Date
Xiaobing Li
ae846e60dd Revert "Set keep_alive to false" (#66)
This reverts commit f71483866633ebbbec0f13ea24be584d4dd0f3c1.
2018-10-04 00:40:43 -04:00
Giancarlo Anemone
f714838666 Set keep_alive to false 2018-10-03 14:11:38 -04:00
Xiaoman Dong
fedec7862d hotfix for using UDEPLOY_SERVICE_NAME instead 2018-09-18 17:50:49 -07:00
mmchen
25e69fdbeb
remove timestamp in data producer produce API (#62)
remove timestamp in data producer produce API
2018-06-28 16:11:49 -07:00
Dennis Lin
6da3633625 only set self.serviceName if truthy, for real 2018-06-07 15:37:32 -07:00
Dennis Lin
1aa3ff298a only set self.serviceName if truthy 2018-06-06 15:29:52 -07:00
mmchen
cd6b7307e1
fix lint issue (#59) 2018-06-06 13:52:23 -07:00
mmchen
af11d0f20d
add producer record (#58) 2018-06-06 13:43:29 -07:00
mmchen
5b19f8e052
add produce API to data producer (#57)
* add produce API to data producer
2018-06-06 12:48:47 -07:00
Dennis Lin
ab950d561b remove trailing spaces 2018-05-09 15:25:01 -07:00
Ryan Tsao
380fc46975
Pass through serviceName config 2018-05-09 14:58:31 -07:00
Xiaoman Dong
1fca771b47 1.10.0 2018-04-16 17:25:33 -07:00
Xiaoman Dong
ebcfa97dff remove the else in else-if-return-else-if-return 2018-04-13 11:21:04 -07:00
Xiaoman Dong
4c5375bca5 fix unit test failure 2018-04-13 11:11:40 -07:00
Xiaoman Dong
409e495302 fix accidental changes 2018-04-13 11:04:57 -07:00
Xiaoman Dong
2ebc15d300 try fixing travis 2018-04-12 16:51:08 -07:00
Xiaoman Dong
a9afaaf289 fix jshint errors 2018-04-12 11:25:14 -07:00
Xiaoman Dong
3196119a92 Address all lint issue 2018-04-06 16:55:17 -07:00
Xiaoman Dong
713116c457 update to use different headers according to sync up 2018-03-27 16:57:58 -07:00
Xiaoman Dong
becf88f1fe Add client-version header and minor fixes 2018-03-22 14:29:14 -07:00
Xiaoman Dong
f63b04d396 Added new file. Somehow lint broken to a point of no good msg 2018-03-19 16:21:38 -07:00
Xiaoman Dong
9affa9ce01 add lineage header support 2018-03-13 14:29:27 -07:00
mmchen
b5944775b6 Add metadataWhitelist option to minimize topic metadata get (#46)
* Add metadataWhitelist option to minimize topic metadata get
2017-05-16 14:32:20 -07:00
mmchen
f5d6ed93ff Default data cluster before going to local agent (#45) 2017-05-08 11:52:19 -07:00
xhl1988
9ca170f76b support key in at-least-once api (#44)
* support key in at-least-once api

* addressing mingmin's comments
2017-03-07 16:42:20 -08:00
xhl1988
c41b16b13f At-least-once API (#42)
* At-least-once API

* add more files

* add more options

* add sync header

* add key

* fix lint error

* addressing xiaobing's comments

* addressing xiaobing's comments

* add local agent port option

* fix format

* addressing xiaobing's comments

* fix bug

* add produceInterval option

* add at-least-once example
2017-02-06 10:30:21 -08:00
mmchen
b5e67539a1 Add localAgentPort in the options (#43)
People have option to not produce to production local agent
2017-01-18 10:19:54 -08:00
Xiaobing Li
1c604a94be Merge pull request #41 from uber-common/enable-c3
Enable c3
2016-12-06 11:09:07 -08:00
Xiaobing Li
503606c519 also cover large msg that exceeds batch maxsize 2016-11-29 18:05:56 -08:00
Xiaobing Li
0f49b4304a defend skewed ts 2016-11-29 15:34:24 -08:00
xhl1988
ad1b61a0d4 Fall back to localagent when hp topic not in metadata & retry twice t… (#39)
* fall back to localagent when hp topic not in metadata & retry twice to local agent

* fix in map situation
2016-11-29 11:10:57 -08:00
Xiaobing Li
ec5ed7db1e timeStamp is in second 2016-11-23 14:59:46 -08:00
Xiaobing Li
a5b5feba5f minor refinement 2016-11-23 11:17:15 -08:00
Xiaobing Li
d4691158b5 enable C3 2016-11-23 09:43:49 -08:00
James Shao
6327181774 fix for circular json in callback 2016-09-19 21:03:50 -07:00
mmchen
65494aa1be delete blacklist related code (#36) 2016-06-08 13:57:30 -07:00
Mingmin Chen
aaf253be33 Version in chaperone audit message 2016-05-24 12:20:28 -07:00
Xiaobing Li
baf630f917 refine audit by align time bucket to 10min 2016-05-11 12:06:01 -07:00
xhl1988
7d539a4b42 handle error code (#34)
* handle respcode 229

* handle error code

* handle error code 5xx

* change error message for 4XX
2016-05-09 15:02:10 -07:00
xhl1988
e17a59a0f4 Fall back to local agent when there is no meta data (#32)
* tmp commit

* enable reconnect to rest proxy

* refactor scheduleReconnect and add comments

* change unit test name

* Add more retry times; make sure retry stops before next refresh cycle

* change version

* change version

* change version

* fall back to local agent when there is no meta data

* add defaultReconnectRetryMs

* remove reconnecing: if there is no meta data and is not connecting, send to local agent directly or drop
2016-05-05 17:21:06 -07:00
Hongliang Xu
5e05b222ea Fix produce type when message exceeds max batch size 2016-04-28 19:05:34 -07:00
Stephen Huenneke
12d7b8a289 Refactor test to explicitly check for correct message writing. 2016-04-19 14:16:58 -07:00
Stephen Huenneke
e4c88a9a74 Adding tests for large message body. 2016-04-19 14:16:47 -07:00
Stephen Huenneke
0a1a8d4f74 Drop messages that aren't strings or Buffer's when received in KafkaProducer.batch() 2016-04-19 14:16:47 -07:00
Stephen Huenneke
7ed9b1fbc7 Move error handling for bad message types (e.g. not buffer and not string) to KafkaProducer.batch() 2016-04-19 14:16:47 -07:00
Stephen Huenneke
639201c0b7 Adding callbacks to avoid throwing errors; Better const-like behavior with Object.freeze on padding constants. 2016-04-19 14:16:47 -07:00
Stephen Huenneke
2bc4d7b481 Add helper methods to properly calculate full size of a single message when it's being sent as a batch. Fixes a bug where messages of length greater than (producer.maxBatchSizeBytes - 8) and producer.maxBatchSizeBytes would end up getting truncated because of offsets in the message Buffer. 2016-04-19 14:16:47 -07:00
Brandon Layton
318aaf0d41 Don't let timeStamp be null 2016-04-18 13:58:54 -07:00
Brandon Layton
de31c077ba log_line 2016-04-13 13:59:55 -07:00
Brandon Layton
5be28182e2 Merge pull request #26 from uber-common/whitelist
Whitelist
2016-04-13 13:04:19 -07:00