96 Commits

Author SHA1 Message Date
wanghao
88f0dd7c8f Introduce the Topic resource into Zaqar-1
This patch will Introduce the Topic resource into Zaqar
and implement the storage in mongodb.

Change-Id: I6d37c93aa75d7df78d3939044b0e8fefa5d9a5f5
Implements: bp introduce-topic-resource-for-notification
2019-03-07 10:16:39 +08:00
Zuul
2d96d9835a Merge "Update mailinglist from dev to discuss" 2018-12-24 11:32:27 +00:00
whoami-rajat
37fc134d11 Add zaqar-status upgrade check command framework
This adds basic framework for zaqar-status upgrade
check commands. For now it has only "check_placeholder"
check implemented.
Real checks can be added to this tool in the future.

Change-Id: I855b4b72284df308c3bb250fd3a3f0fc643b4abf
Story: 2003657
Task: 26165
2018-12-12 06:08:06 +00:00
Jonathan Herlin
3dbdeead38 Update mailinglist from dev to discuss
openstack-dev was decomissioned this night in https://review.openstack.org/621258
Update openstack-dev to openstack-discuss

Change-Id: I115c89897b5afa687b4f4a1cea6257b5ee2419c6
2018-12-11 11:18:58 +00:00
xywang
a7df08deb9 CONF file structure refactor
This is the openstack governance goal that the config files should
be merged into one folder to make the code to be better understood
and managed.

Change-Id: I33dd85145d9f5b0384323ffa51b4d68de0aeb5b7
2018-06-04 09:11:46 +08:00
xywang
17ef71a482 Follow the new PTI for document build
For compliance with the Project Testing Interface as described in:
https://governance.openstack.org/tc/reference/project-testing-interface.html

For more detials information, please refer to:
http://lists.openstack.org/pipermail/openstack-dev/2017-December/125710.html

Change-Id: I444cdaad0d83d9d8795dc03793aefe2fa3a51203
2018-05-22 06:12:22 +00:00
Chandan Kumar
bceb83d1fe Remove bundled intree tempest plugin from Zaqar
The plugin has been split into its own repository[1] in accordance with
Queens Goal "Split Tempest Plugins into Separate Repos/Projects[2]".
This patch removes the local copy as well as the setuptools entry point.
We can also now remove the autodoc_tree_excludes pbr option since
there's no more plugin to exclude and it defaults to [setup.py].

[1] http://git.openstack.org/cgit/openstack/zaqar-tempest-plugin
[2] https://governance.openstack.org/tc/goals/queens/split-tempest-plugins.html

Implements: blueprint zaqar-tempest-plugin

Change-Id: Ia52d7f0a18e4b55260dc994f0802a96109280e24
2017-10-26 13:03:23 +05:30
Lance Bragstad
3f7cc0a460 Implement basic policy module in code
This change prepares the zaqar project to start implementing policies
in code. Subsequent patches will register more zaqar policies in code
and remove the corresponding entry from the policy file maintained in
source.

This is part of a community effort to provide better user experience
for those having to maintain RBAC policy. More information on this
effort can be found below:

  https://governance.openstack.org/tc/goals/queens/policy-in-code.html

bp policy-and-docs-in-code

Change-Id: I5d804b589df215fddc18257fc9f05ba2e0d708bd
2017-10-10 06:28:29 +00:00
Luong Anh Tuan
a16d7f2210 Update URL home-page in documents according to document migration
Change-Id: I8182ec8303d85568c9ef12dcf1cb8cd30fae3624
2017-07-18 02:29:29 +00:00
Andreas Jaeger
371ff39c7d Use Sphinx 1.5 warning-is-error
With pbr 2.0 and Sphinx 1.5, the setting for treat sphinx warnings as
errors is setting warning-is-error in build_sphinx section. Migrate
the setting from the old warnerrors one.

Fix also problems found:
* code-blocks that could not be parsed
* Usage of :option: without declaring the option.
* Add blank lines to properly end markup.
* Fix a typo.
* Fix wrong markup of docstring
* Fix title underlinings.

Change-Id: I69ddde706a04f26bfccda072822dc0d230cb330e
2017-03-04 19:59:54 +01:00
Jenkins
c1f51dcf68 Merge "Remove py34 support in favour of py35" 2017-01-27 10:17:25 +00:00
Fei Long Wang
95b2290ac1 Remove py34 support in favour of py35
Change-Id: Iceb1a9c54728011a78874c32197391a1d2c5fd67
2017-01-16 16:56:20 +13:00
Ryan S. Brown
40083a720c Swift storage
Implement storing of queues, messages, subscriptions in Swift.

Change-Id: I94e158b35b069ea1fbf8dde17c89ff9b9c758ab4
2017-01-05 09:21:21 +01:00
Fei Long Wang
fb8da5d535 Add support for sqlalchemy migration based on alembic
Implement blueprint: sqlalchemy-migration

Change-Id: Ifd0d5186299611907a388f8ab8b27e312a3cb60d
2016-12-13 02:28:10 +00:00
gengchc2
ef50510d77 modify the home-page info with the developer documentation
update home-page info

Change-Id: Id529ab51952dd0b573c1f20d256c270b526fd7c0
2016-07-29 16:50:41 +08:00
Jenkins
bab10869f9 Merge "Add Python 3.5 classifier and venv" 2016-07-14 08:57:17 +00:00
Jenkins
2871900052 Merge "Add a trust notifier task" 2016-07-13 03:44:25 +00:00
Yatin Kumbhare
8703ead0c2 Add Python 3.5 classifier and venv
Now that there is a passing gate job, we can claim support for
Python 3.5 in the classifier. This patch also adds the convenience
py35 venv.

Change-Id: Ifb0804dd27c5e14418ec61ddfed0790d693d1bde
2016-07-12 17:41:43 +05:30
Thomas Herve
51604b4954 Add a trust notifier task
This adds the ability to send keystone authentified notifications using
trusts. To do so, you specify the posted URL with the "trust+" prefix,
and Zaqar will create and store a trust when subscribing to a queue, if
the trust not provided in the subscription options

It also add a capability to the webhook task to be able to send more
structured data in the notification, allowing to include the Zaqar
message in the data.

blueprint mistral-notifications
DocImpact
Change-Id: I12b9c1b34cdd220fcf1bdc2720043d4a8f75dc85
2016-07-07 08:58:42 +02:00
Flavio Percoco
62e92fc6dc Disable warnerrors=true in setup.cfg
The upcoming `pbr` release will make this flag effective and it may
result in broken tests and/or gate jobs. Disable for now till the next
release is out so we can re-enable it later and manage possible errors
alltogether.

Change-Id: Ic483121ff850319838d6b33e39059e6bdda9a88b
2016-07-06 15:06:22 +02:00
Fei Long Wang
ebc6721b4f Rename notification/task to notification/tasks
We're using zaqar.notification.tasks to look for the notifier
driver by stevedore, so this patch just rename the package
name to keep consistence. No impact for end user and migration.

Change-Id: I7694af4dbc4f73703e429560fb0a1457f3e1193a
2016-05-27 10:04:20 +12:00
Matthew Treinish
dce51da5b0
Add zaqar tempest plugin
This commit takes the zaqar tests which previously lived in tempest
and creates an in-tree tempest plugin out of them.

Change-Id: I06053d2d0d761c6398708280f3ef38274dec390c
2016-02-18 20:41:07 -05:00
Doug Hellmann
ed3418e9dd remove python 2.6 trove classifier
OpenStack projects are no longer being tested under Python 2.6, so
remove the trove classifier implying that this project supports 2.6.

Change-Id: I3db4da6cdfac6163ccb54467c5269b5076892690
2015-12-23 01:31:17 +00:00
Fei Long Wang
7b4ce34931 Remove version from setup.cfg
Per [1] we now want to use the git repository for knowing the version
instead of just trying to modify the setup.cfg file.

[1] http://lists.openstack.org/pipermail/openstack-dev/2015-November/080692.html

Depends-On: Ifa41ef5b856c2726c165a51944069dc1ac3a16cc
Change-Id: I884d1196f0320d85257f521591d36ed7cfbc8013
2015-12-02 15:15:32 +00:00
Thomas Herve
169739a33b Switch to oslo_cache
Move from the incubator cache module to oslo_cache/dogpile. It removes
all now unused incubator modules.

Change-Id: Ie1cbacab262e47cee3fde513081a7d70a624dbd9
2015-09-23 11:44:44 +02:00
Thierry Carrez
6282521c16 Open Mitaka development
Bump preversion to mark the start of the Mitaka development branch.
The liberty release branch will be cut from the previous commit.

Change-Id: Ie0d9dc46680631d4d3afdb7111a314012d531c73
2015-09-22 16:27:15 +02:00
Fei Long Wang
8ce9d3eaef Add email driver for notification
DocImpact
blueprint email-notification

Change-Id: Ib09f7d3b47c3a4479da7fb9b9e2acceb691975ac
2015-09-03 11:46:00 +02:00
Fei Long Wang
a128dbc3ac Refactor notification framework
1. Using stevedore to load the task instance
2. Pass in messages list to task instead of single message

Change-Id: Ie8a475b8c2530bfd0fb2d39929c1611288c601fe
2015-08-06 21:22:31 +12:00
Flavio Percoco
3f3e99f587 Move common configs under common.configs
We've some options in bootstrap and other places that should probably go
to a common place so that we can guarantee they are always registered
when the Zaqar starts.

This patch adds a new zaqar.common.config module that holds all the
common configs but doesn't register them. This step is still performed
when it is required.

Change-Id: I9941095ed56835093d56b5ad2bf85b53bdda0c8b
Partially-Implements: pre-signed-url
2015-07-07 14:25:36 +02:00
Thomas Herve
85a2f8159f Move functional tests out of tests/
This moves functional tests out of the tests directory and removes it.

blueprint tests-refactoring

Change-Id: I0e0fb4e914ede02ea2f02fa19cf898888f38b57d
2015-06-19 09:55:41 +02:00
Doug Hellmann
3dc6526af8 Update version for Liberty
Update the version for Liberty, switching from date-based versioning
to pre-versioning using SemVer. See
http://lists.openstack.org/pipermail/openstack-dev/2015-May/065211.html
and
http://lists.openstack.org/pipermail/openstack-dev/2015-June/067082.html
for details.

Change-Id: I6a35fa0dda798fad93b804d00a46af80f08d475c
2015-06-16 19:49:15 +00:00
Jenkins
64317c234f Merge "Remove the sqlite entry point" 2015-06-08 12:36:47 +00:00
Flavio Percoco
29c20c849f Remove the sqlite entry point
This entry point existed for backwards compatibility. It's not needed
anymore, make ppl move to sqlalchemy if needed.

Change-Id: I2715961bae9473b55a68af6d9441d83ccdf85735
2015-06-05 11:16:36 +02:00
Flavio Percoco
803c62b189 Remove marconi-server
The marconi-server entry point was kept for backwards compatibility. It
should be safe to remove it now.

Change-Id: I912e57cb4e72e185e00067c950d6dfc7fc6dd9b9
2015-06-04 16:41:20 +02:00
Thierry Carrez
e997d5850c Open Liberty development
Bump pre-version in setup.cfg to formally open Liberty development.
Kilo release branch will be cut from the previous commit.

Change-Id: If6139cb09d14038f6a3acec0170c3cf665a24085
2015-04-09 17:03:52 +02:00
Shaifali Agrawal
c3a5718775 Remove QueueController from data to control plane
To separate data and control plane of storage layer;
Moving queue_controller from data to controll plane.
Trying to shift the QueueController object in Control plane.
For this new MessageQueueHandler class is also added inside storage/x/messages.py
And the newly added handler is added to the entry point.

Implements: blueprint split-data-and-control-plane
Co-Author: Flavio Percoco<flavio@redhat.com>

Change-Id: I8a167d6ed8e54c98b077b9ea56e68b4e8d5b0291
2015-04-02 19:22:38 +02:00
Fei Long Wang
99fe10e49c Implement webhook notifier driver
This patch adds a notifier driver for webhook and the basic
task management code with taskflow.

DocImpact
Partially-Implements blueprint: notifications

Change-Id: I2727726cc57f03fb94184653452223f00fcf3d0c
2015-04-01 14:27:35 +13:00
Flavio Percoco
35f2764204 Remove sqlalchemy from our data plane
This patch removes the sqlalchemy as a valid data driver. In order to
make this work properly, we also need the data plane to be properly
split into 2 completely independent pipelines.

This patch, unfortunately, disables some of the sqlalchemy's tests for
queues and pools. The reason is that, until these planes are correctly
separated and pooling is enabled by default, we won't be able to
properly run those tests. A follow-up patch, expected to land in kilo,
will do this.

DocImpact

Implements blueprint: disable-sqlalchemy-as-pool

Change-Id: I5ca73102241692b0e1b23b3eaaaf1938f0106dfa
2015-03-29 18:26:36 -03:00
Jenkins
593a4848eb Merge "Adds websockets driver to Zaqar server" 2015-03-11 23:20:00 +00:00
Victoria Martinez de la Cruz
f3ab5b3fb5 Adds websockets driver to Zaqar server
Inits the server and adds a websockets dummy protocol.
asyncio has been selected as the server and autobahn as the
websockets library (pending discussion with the team).

Controllers will be added in the following changes.

Partial-Implements: blueprint persistent-transport

Change-Id: Ia2a9b02847ec6f61c07b597e607f8fa316672518
2015-03-11 17:02:01 -03:00
Flavio Percoco
d9faff354d Split MongoDB's default implementation from FIFO's
The patch adds support for both FIFO and non-FIFO mongodb
implementations. It takes advantage of the `uri` scheme to determine
whether the FIFO implementation is needed or not.

A follow-up patch will improve this driver loading phase to match what's
been stated in the spec.

DocImpact
Partially-Implements blueprint: expose-storage-capabilities

Change-Id: Ic25e1893d0bab640ac038097ed89e5b699d5490a
2015-02-13 23:56:48 +01:00
Fei Long Wang
166abfd303 Refactor code structure for notification
Given we are going to implement notification, so the 'queues'
package is not suitable for current scope of zaqar. This
patch will remove the 'queues' package.

Partially implements: blueprint notifications

Change-Id: I6984f31f4bd1e646b585c45c088ed239b58587c4
2014-12-09 16:19:42 +13:00
Flavio Percoco
4a9737117d Open Kilo development
Bump pre-version to 2015.1 to formally open master branch to Kilo
development.

Change-Id: I14dd2b83b6c5aea1df9221e1433b7593c303ea6f
2014-10-02 17:37:49 +02:00
Jeffrey Zhang
ea6a221f68 Add the redis opts to the generate sample shell script
* Fix the redis opts typo in setup.cfg
* Fix the default value type for reconnect_sleep in redis
* add the redis to oslo.config.generator.rc

Change-Id: Ibd439e2bdaa46ddf21802724f9fe7fb6f2b61bc5
2014-09-18 00:07:54 +08:00
Victoria Martínez de la Cruz
26a3d584b7 Adds a manual garbage collector script
It's the responsibility of the operator to call the garbage
collector manually. Using crontab or a similar tool is advised.

A more intelligent approach for this will be added in a follow-up
patch.

Change-Id: I9cf22a5c65920be0eaff909c8f090d29ef300d1f
2014-09-02 21:52:05 -03:00
Jenkins
89aa8d0734 Merge "Implements queue, message and claim controllers for Redis" 2014-09-01 21:21:14 +00:00
Prashanth Raghu
76f6e063db Implements queue, message and claim controllers for Redis
This patch implements the standard controllers for the redis
storage driver. It has been tested against a localhost Redis
server with ZAQAR_TEST_REDIS=1.

Change-Id: Ib7c100afd11a0410c3f241c1925d5aaf172ce6a8
Partially-Implements: blueprint redis-storage-driver
2014-08-30 15:45:27 -05:00
kgriffs
07ddeee517 Add observer role to benchmark tool
This patch introduces a new observer role, which lists messages but
does not claim them. As part of this work the config options were
updated and the defaults adjusted to provide a better "kick the
tires" experience.

The default number of procs and workers is now hard-coded rather
than being based on number of available CPUs, since the number of
workers you may want to run is more dependent on the size of your
Zaqar deployment and your network bandwidth than it is on the
number of CPUs on the load generator.

Finally, the "-pc" suffix was removed from the command name. This
was included in this patch because it didn't seem significant
enough to split out.

Change-Id: I8a8190fb2cebc3489c78da4f6e1e7c51d8b97017
2014-08-29 10:30:51 -05:00
Flavio Percoco
e7c98874cd Fix config generator in Zaqar
This patch updates the config generator imports and generates a new
version of the config sample.

Change-Id: I7bb54c1c308aeafd654f5e13d9d0cc24385a5b6e
2014-08-22 15:33:32 +02:00
Flavio Percoco
36e63c9a45 Rename Marconi to Zaqar
This patch renames every package, file, match of Marconi in the codebase
to Zaqar *except* for the .gitreview file, which will have to be updated
*after* I8e587af588d9be0b5ebbab4b0f729b106a2ae537 lands.

Implements blueprint: project-rename

Change-Id: I63cf2c680cead4641f3e430af379452058bce5b3
2014-08-04 10:36:50 +02:00