1. 26 7月, 2019 5 次提交
  2. 25 7月, 2019 1 次提交
  3. 24 7月, 2019 5 次提交
  4. 23 7月, 2019 2 次提交
    • M
      Process requests asynchronously on some REST APIs (2) (#4778) · 2cc34afc
      massakam 提交于
      Master Issue: #4756
      
      ### Motivation
      
      This is a continuation of https://github.com/apache/pulsar/pull/4765.
      
      ### Modifications
      
      Added async rest handlers to the following APIs:
      ```
      DELETE /admin/namespaces/{tenant}/{cluster}/{namespace}
      PUT    /admin/namespaces/{tenant}/{cluster}/{namespace}/unload
      POST   /admin/namespaces/{tenant}/{cluster}/{namespace}/clearBacklog
      POST   /admin/namespaces/{tenant}/{cluster}/{namespace}/clearBacklog/{subscription}
      POST   /admin/namespaces/{tenant}/{cluster}/{namespace}/unsubscribe/{subscription}
      
      DELETE /admin/v2/namespaces/{tenant}/{namespace}
      PUT    /admin/v2/namespaces/{tenant}/{namespace}/unload
      POST   /admin/v2/namespaces/{tenant}/{namespace}/clearBacklog
      POST   /admin/v2/namespaces/{tenant}/{namespace}/clearBacklog/{subscription}
      POST   /admin/v2/namespaces/{tenant}/{namespace}/unsubscribe/{subscription}
      ```
      2cc34afc
    • M
      Added more blog posts in the resources page (#4774) · 8e1d00ff
      Matteo Merli 提交于
      * Added more blog posts in the resources page
      
      * Added 2 more posts
      8e1d00ff
  5. 22 7月, 2019 6 次提交
  6. 21 7月, 2019 12 次提交
    • M
      Allow to configure ack-timeout tick time (#4760) · f13af487
      Matteo Merli 提交于
      ### Motivation
      
      After the changes in #3118, there has a been a sharp increase of memory utilization for the UnackedMessageTracker due to the time buckets being created. 
      
      This is especially true when the acktimeout is set to a larger value (eg: 1h) where 3600 time-buckets are being created. This lead to use 20MB per partition even when no message is tracked.
      
      Allowing to configure the tick time so that application can tune it based on needs.
      
      Additionally, fixed the logic that keeps creating hash maps and throwing them away at each tick time iteration, since that creates a lot of garbage and doesn't take care of the fact that the hash maps are expanding based on the required capacity (so next time they are already of the "right" size). 
      
      On a final note: the current default of 1sec seems very wasteful. Something like 10s should be more appropriate as default.
      f13af487
    • S
      [test] add getters and setters to PulsarService & BrokerService (#4709) · 5cff1691
      Sijie Guo 提交于
      *Motivation*
      
      When using PulsarService or BrokerService for testing, it might require accessing
      the components in PulsarService and BrokerService. This change is adding setters
      and getters to access the components in PulsarService & BrokerService
      5cff1691
    • B
      Fix: Add kubernetes namespace to function instance url (#4701) · 8c3445ad
      Boyang Jerry Peng 提交于
      ### Motivation
      
      
      Currently, if the kubernetes namespace set to deploy functions in is different than the one in which brokers/workers reside, get status and stats doesn't work because the url for instances does not specify the namespace.
      8c3445ad
    • M
      Removed specialization of CopyOnWriteArrayList class (#4710) · e7c81096
      Matteo Merli 提交于
      ### Motivation
      
      Switched back to use the regular `java.util.concurrent.CopyOnWriteArrayList` instead of the class extending it since we don't really have any advantage in accessing the underlying array of objects. 
      
      The reflection being used to get that field is giving errors on Java 12. 
      e7c81096
    • T
      Fix document of debezium (#4713) · 1852dc38
      tuteng 提交于
      ### Motivation
      
      There are some typos in the document content of about debezium, which affect users' use, so fix it.
      
      ### Modifications
      
      Fix typos in document of debezium. And format content 
      1852dc38
    • Y
      Increasing Dashboard consumerName field to 256 varchar (#4716) · d7b3af00
      Yuvaraj L 提交于
      * Changed remove-backlog-quotas to remove-backlog-quota
      
      * Changed remove-backlog-quotas to remove-backlog-quota
      
      * Increased the consumerName field to varchar(256)
      Signed-off-by: NYuvaraj Loganathan <uvaraj6@gmail.com>
      d7b3af00
    • B
      [docs] add memory requirement and config tips for standalone mode (#4717) · 1087dad7
      Brandon 提交于
      * add memory requirement and config tips for standalone mode
      
      In the current standalone get start doc, there is no mentioning or link for the memory usage of the pulsar. 
      User with limited free memory may encounter issue to start the Pulsar. 
      Adding the tips on how to change the default required heap memory.
      
      1087dad7
    • B
      [docs] add security warning on standalone doc (#4719) · b897f5e1
      Brandon 提交于
      * [docs] add security warning on standalone doc
      
      Add a fair warning on standalone get start document.  Since by default configure, Pulsar can be accessed from remote server without any authentication, encryption, authentication.  So a fair warning to the user is critical to avoid any unexpected security risks.
      b897f5e1
    • B
      26fc4efe
    • R
      set go function executable when download to local (#4743) · bf58c8eb
      Rui Fu 提交于
      ### Motivation
      
      Currently golang function needs to be compiled before deploy to pulsar, so the executable permission is required when function package is downloaded to local node from bookkeeper. This PR is intent to make golang function package executable after download from bookkeeper, to make sure the function is ok to run.
      bf58c8eb
    • J
      Allow to create partitioned topic with 1 partition (#4764) · 5162393c
      Jia Zhai 提交于
      **Motivation**
      when create partitioned topic, there is a check that `numPartitions > 1`, if numPartitions==1, it will fail.
      Some user may want to create partitioned topic with only 1 topic at the start time, and during using it, could update to more topics later. 
      
      **Modification**
      change check of `numPartitions > 1` to `numPartitions > 0`
      
      expect all existing ut passed.
      5162393c
    • J
      [docs] Add functions-debug file for Pulsar Functions(new) (#4729) · af6d4dab
      Jennifer Huang 提交于
      * add functions-debug file for new structure
      
      * update a few typos
      af6d4dab
  7. 20 7月, 2019 3 次提交
  8. 19 7月, 2019 6 次提交
    • T
      [doc][download]Fix download link not found in document (#4714) · 81ab4eed
      tuteng 提交于
      * Fix download link not found in document
      
      * Update sorted
      81ab4eed
    • Y
      add timeout to internal rest api (#4762) · 9605aede
      Yuto Furuta 提交于
      9605aede
    • C
      Get schema info with topic partition (#4751) · 8b197c6b
      congbo 提交于
      8b197c6b
    • M
      Fix C++ log level names in Log4cxxLogger (#4735) · af8ea71a
      massakam 提交于
      ### Motivation
      
      If trying to build master C++ code with the `USE_LOG4CXX` flag turned ON, compilation errors occur:
      ```
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc: In static member function ‘static log4cxx::LevelPtr pulsar::Log4CxxLogger::getLevel(pulsar::Logger::Level)’:
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:53:18: error: ‘DEBUG’ was not declared in this scope
                   case DEBUG:
                        ^
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:55:18: error: ‘INFO’ was not declared in this scope
                   case INFO:
                        ^
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:57:18: error: ‘WARN’ was not declared in this scope
                   case WARN:
                        ^
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:59:18: error: ‘ERROR’ was not declared in this scope
                   case ERROR:
                        ^
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:52:16: error: enumeration value ‘LEVEL_DEBUG’ not handled in switch [-Werror=switch]
               switch (level) {
                      ^
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:52:16: error: enumeration value ‘LEVEL_INFO’ not handled in switch [-Werror=switch]
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:52:16: error: enumeration value ‘LEVEL_WARN’ not handled in switch [-Werror=switch]
      /tmp/pulsar/pulsar-client-cpp/lib/Log4cxxLogger.cc:52:16: error: enumeration value ‘LEVEL_ERROR’ not handled in switch [-Werror=switch]
      cc1plus: some warnings being treated as errors
      make[2]: *** [lib/CMakeFiles/pulsarStatic.dir/Log4cxxLogger.cc.o] Error 1
      make[2]: *** Waiting for unfinished jobs....
      ```
      
      This is because the enum values renamed in https://github.com/apache/pulsar/pull/4664 are still used in `Log4cxxLogger.cc`.
      
      ### Modifications
      
      Fixed the enum values used in `Log4cxxLogger.cc` by adding the prefix `LEVEL_`.
      af8ea71a
    • [issue 4589] Fix redelivered message logic of partition topic (#4653) · cc5f25bf
      冉小龙 提交于
      Fixes #4589
      
      Motivation
      When using Partition-topic, the logic of redeliver messages will not be triggered when the time of ackTimeout arrives.
      
      This is because the unAckedMessageTrackerPtr_->add(msg.getMessageId()) is not call in the listener handling of partitioned topic in cpp code
      cc5f25bf
    • L
      Change type of publish_time to timestamp (#4757) · 6f5416ee
      lipenghui 提交于
      Fixes #4734
      
      ### Motivation
      
      "publish_time" is Pulsar SQL internal column, as Pulsar only stores timestamps, it doesn’t store the timezone information. Use timestamp as "publish_time" type is more correct way in Pulsar SQL.
      
      ### Modifications
      
      Change type of publish_time to timestamp.
      
      ### Verifying this change
      
      predicate of publish_time is pushdown
      
      Use `__publish_time__` to trim messages:
      ```
      SELECT COUNT(*)
      FROM "sql-test-1" 
      WHERE "__publish_time__" >= TIMESTAMP '2019-07-18 17:26:50.119' 
      AND  "__publish_time__" < TIMESTAMP '2019-07-18 17:26:51.119';
      ```
      ![image](https://user-images.githubusercontent.com/12592133/61447301-43835080-a983-11e9-814b-bc2b378f02b9.png)
      
      Without `__publish_time__` predicate:
      ```
      SELECT COUNT(*)
      FROM "sql-test-1";
      ```
      ![image](https://user-images.githubusercontent.com/12592133/61447427-82190b00-a983-11e9-8d3f-3bf2a4798047.png)
      6f5416ee