- 20 11月, 2019 2 次提交
-
-
由 Jia Zhai 提交于
Fixes #4909 ### Motivation It would be good to expose method `getLastMessageId` in `ConsumerImpl` to a public method. eg. some times user would like to know the lag messages; or only consume messages before current time. ### Modifications - expose method `getLastMessageId` in consumer api. - add unit test. ### Verifying this change Ut passed (cherry picked from commit 93d95c74)
-
由 xiaolong.ran 提交于
Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com>
-
- 19 11月, 2019 38 次提交
-
-
由 Sijie Guo 提交于
* Data is not deleted after expiration due to connected readers *Problem* A problem is observed when stress testing pulsar using [pulsar-flink](https://github.com/streamnative/pulsar-flink) - No matter what TTL or retention setting is used, the data is never cleaned up. So the stress test ends up failing due to disk filled up. The root cause of the problem is described as below. when a reader is opened using `MessageId.earliest`, a non-durable cursor with position (-1, -2) is added to the cursor heap. The position `(-1, -2)` in the heap is never updated because non-durable cursors are never advanced when mark-deletions happen. So the slowest cursor position is always `(-1, -2)`, thus causing no ledger can be deleted even they are expired or over quota. *Motivation* Fix the problem to make sure Pulsar honor to TTL and retention settings. *Modifications* - Fix the `startPosition` when PersistentTopic opens a non-durable cursor on `MessageId.earliest`. So the `startPosition` is (-1, -1) not (-1, -2). - Fix the `NonDurableCursorImpl` constructor to check if the position in the ledger of `MessageId.earliest`. If the provided position is in the `earliest` ledger, the mark-deleted position will be set to the previous position of first position. - Fix the `NonDurableCursorImpl` to advance ledger cursor when mark-deletion happens on a non-durable cursor. *Verify this change* Unit tests are coming. (cherry picked from commit 3e7cb68b)
-
由 冉小龙 提交于
Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> Fixes: #2719 ### Motivation In website, the go client docs missing. ### Modifications Add missing docs for go client. (cherry picked from commit 006f291b)
-
由 Boyang Jerry Peng 提交于
(cherry picked from commit b7b9926b)
-
由 huangdx0726 提交于
* support mongodb connector * fix typo * revert (cherry picked from commit 96a94188)
-
由 冉小龙 提交于
Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> (cherry picked from commit 5c771d20)
-
由 冉小龙 提交于
* Fix docs about reset cursor Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> * fix comments Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> (cherry picked from commit 80e4b5f6)
-
由 冉小龙 提交于
* Add subscribe position param for consumer of sink Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> (cherry picked from commit 39af4777)
-
由 Boyang Jerry Peng 提交于
* fix: Functions unnecessarily restart during FunctionRuntimeManager init phase (cherry picked from commit dd58baf8)
-
由 Yong Zhang 提交于
* Fix list non-persistent topics shows the persistent topics --- Fixes #5414 *Motivation* When using the REST API to request to list all the non-persistent topics, it will show the persistent topics. *Modifications* - Add a filter when before sending the response (cherry picked from commit 79f47106)
-
由 Matteo Merli 提交于
### Motivation While this doesn't appear to affect the correctness, we should just return empty after we trigger the callback. (cherry picked from commit 734e7484)
-
由 Matteo Merli 提交于
There is a race condition when replaying messages on the `PersistentDispatcherMultipleConsumers`. This is apparently only happening in the context of delivering messages after a scheduled delay. The `Dispatcher.readMoreEntries()` can get invoked in multiple occasions: * Piggybacking on the completion of the previous read operation * When the delaye tracker gets triggered If there is already a replay read operation pending, we're currently ignoring the message ids returned by the delay tracker. These messages will not be retried on any other occasion, leading to backlog building up (until a consumer disconnects/reconnects). (cherry picked from commit 01ca24b3)
-
由 Matteo Merli 提交于
Efficiency improvements for delay delivery tracker (cherry picked from commit 467ffab1)
-
由 Jennifer Huang 提交于
There are some link issues on Pulsar website, check and fix them. (cherry picked from commit f538c522)
-
由 Jennifer Huang 提交于
* add thread/process modes * update the differences between thread and process modes * update * update (cherry picked from commit 8c163eb2)
-
由 Brian Candler 提交于
Fixes #5484 (cherry picked from commit 6df7cec6)
-
由 Brian Candler 提交于
Fixes #5365 (cherry picked from commit 49a8658c)
-
由 Raman Gupta 提交于
* [Issue 5309][docs] Clarify wording around retention policies Fixes #5309 Docs are confusing. Replaced retention wording to make distinction between acked and non-acked messages clearer. * [Issue 5309][docs] Remove TODO (cherry picked from commit 418362e1)
-
由 Rajan Dhabalia 提交于
Fix broken custom auth-provider that uses authenticationData (cherry picked from commit ebaf97cc)
-
由 Matteo Merli 提交于
(cherry picked from commit ddf5429e)
-
由 Rajan Dhabalia 提交于
(cherry picked from commit 0c7319fc)
-
由 Rajan Dhabalia 提交于
* [pulsar-client] Fix message corruption on OOM for batch messages * remove comments * Address comments: index in local-var + remove lastSerializedMessageIndex var (cherry picked from commit bf9a9019)
-
由 Rajan Dhabalia 提交于
(cherry picked from commit b466b085)
-
由 Rajan Dhabalia 提交于
* [pulsar-perf] record message failure and avoid exiting from process on publish failure * add flag to exit on publish failure (default: disable and continue) (cherry picked from commit c59a37b2)
-
由 Boyang Jerry Peng 提交于
(cherry picked from commit 8a022064)
-
由 Boyang Jerry Peng 提交于
This reverts commit d49e61e0. (cherry picked from commit c4035d3d)
-
由 Masahiro Sakamoto 提交于
* Fix bug that namespace policies does not take effect due to NPE * Prevent NPE if Dispatcher and DispatchRateLimiter return to null (cherry picked from commit 84a519fa)
-
由 Rajan Dhabalia 提交于
* [pulsar-broker] Fix: race condition : Failed to read-more entries on dispatcher * clean up non-used method (cherry picked from commit 13ea25a3)
-