x/stacktach
Code Issues Proposed changes
660 Commits 2 Branches 2 Tags
ca070c246d
Commit Graph

53 Commits

Author SHA1 Message Date
Andrew Melton
ca0ee9f3d0 Fixing logging 
First, setting up the default logger name for worker and verifier.
Without this, logging from the reconciler and the database api
will end up in stacktach-default. This would mean both the
verifier and worker will be attempting to rotate that log file,
thus locking themselves.

Second, using the child logging process when calling the
info/warn/error functions directly in stacklog. Othweise this will
cause the callers to get or create the parent logger process.
 2013-11-07 10:12:55 -05:00
Andrew Melton
eaf7f9a290 Correctly ending loggers 2013-11-06 14:22:41 -05:00
Anuj Mathur
baaba5d3e7 Implemented multiprocess logging 2013-11-05 20:13:46 +05:30
Andrew Melton
fde85b1d68 Get or create deployment in parent process 
Doing this in the parent process avoids a race condition
where two consumers for a single deployment attempt to
create new deployments at the same time. Thus, creating
duplicate deployments.
 2013-10-25 11:02:52 -04:00
Andrew Melton
1e75d7230a Adding queue name to worker topic config 2013-08-22 09:47:39 -04:00
Anuj Mathur
4ebdd61ed0 Revert "Merge pull request #176 from rackerlabs/master_no_glance_verify" 
This reverts commit ea0b42df4842449f99ccc022e5f79bff2ebc0ba6, reversing
changes made to 510cdda0d0c6688b0ec5e9712a8beac1b1a6cb31.
 2013-08-22 16:28:13 +05:30
Andrew Melton
25dbb53d1f Revert "Merge pull request #171 from manalilatkar/GlanceVerifier_222" 
This reverts commit 139f9cdbead8ae85af59206b1f14c9d4044da639, reversing
changes made to 06318c44e11c7bbf1b3f425670c1194e83762201.
 2013-08-19 12:08:34 -04:00
Andrew Melton
139f9cdbea Merge pull request #171 from manalilatkar/GlanceVerifier_222 
Glance verifier 222
 2013-08-16 11:06:06 -07:00
Raghu Rao
8001ca0403 Fixed typo in worker/stacktach.sh 2013-08-14 08:37:48 -05:00
Raghu Rao
0ea1373586 Added pidfile argument to the "status" command of the initscripts for worker and verifier 2013-08-13 15:54:01 -05:00
Anuj Mathur
08311b2dd4 - Created glance verifier and nova verifier 
- Extracted common verifier functionality into a base verifier
- Extracted messaging specific functionality into message service
- Moved methods into models
- Moved reconciler creation into start_verifier
 2013-08-05 19:19:37 +05:30
Andrew Melton
691c2833cc Unique Queue Names Per Exchange. 
Each service's queue needs to be uniquely named so that other
services notifications don't end up in each other's queue.
 2013-07-30 14:59:12 -04:00
Andrew Melton
a709d957fd Adding queue_name to worker config. 
The idea behind this is to allow consumption of notifications
    from a service that can only emit notifications on a
    single routing_key.
 2013-07-30 11:51:55 -04:00
Anuj Mathur
32a73158ef Extracted save method for image_exists to glance_notification 2013-07-18 13:52:58 +05:30
Anuj Mathur
ec5bbf31a2 Added image exists, usage and delete models for glance 2013-07-18 13:52:58 +05:30
Anuj Mathur
3b1e086a26 - Moved config.py to worker 
- Removed exchange from config and started reading them from topics
- Fixed lengths of GlanceRawData fields to match Glance fields
- Made uuid and status accept null values as the image.send notification does not contain those values
 2013-07-18 13:52:58 +05:30
Manali Latkar
3f6542f049 - Added logic to populate generic rawdata and glance rawdata 
- Moved the responsibilty to save rawdata to the notification classes
- Notification are now created based on exchange instead of routing_key since routing_keys
  may not be unique across services
- Separate consumers are now created for every exchange specified in the config
- Each consumer is started in a separate process
- Introduced notification factory and the config module
 2013-07-18 13:52:58 +05:30
Anuj Mathur
9421e9be95 Increased list of fields that are verified 
Moved _monitor_message and _compute_update_message code and
tests to MonitorNotification and ComputeUpdateNotification
 2013-06-24 18:57:18 +05:30
Andrew Melton
f601dff52f Singleton stacklog 2013-05-28 17:54:12 -04:00
Andrew Melton
93fd8ad8b7 Fixing some usage bugs 2013-05-28 14:20:00 -04:00
Thomas Maddox
deef5f14eb removed else in exit_or_sleep 2013-05-23 14:16:57 -05:00
Thomas Maddox
c759a48e59 log failed message and raise to kill worker 2013-05-23 14:11:22 -05:00
Thomas Maddox
b5ac556213 made exit_on_exception backward compatible 2013-05-23 10:12:56 -05:00
Thomas Maddox
050179b01e fixed bad exit arg for exit on exception 2013-05-23 10:05:28 -05:00
Thomas Maddox
e09a889f42 added exit_on_exception configuration to worker 2013-05-23 10:03:19 -05:00
Thomas Maddox
b815516b5f changed to only post process if successful 2013-05-22 13:36:00 -05:00
Thomas Maddox
54a1f5fb0e moved ack to after save of raw 2013-05-22 10:40:09 -05:00
stev5232
6a430380f0 Rotate log when process starts 2013-05-01 12:39:43 -04:00
Andrew Melton
a2d3015bf2 Distinct log message in worker exception handling 2013-04-26 15:44:24 -04:00
Andrew Melton
8118fb8fab Only ack message if successfully processed 2013-04-26 13:14:08 -04:00
Andrew Melton
8369eeafbb Using ujson or simplejson in worker if available. 2013-03-19 15:46:45 -04:00
mendeni
cdbac0dcd6 Added restart, status, lsb init header 2013-03-04 13:02:25 -05:00
Andrew Melton
e8131625d0 Adding gets for individual dbapi resources 2013-02-14 16:35:00 -05:00
Sandy Walsh
5f1a748123 merge errors and a datetime fix 2013-02-13 14:38:59 -06:00
Sandy Walsh
a5123d916d Support for task state, image_type and pretty summary report 2013-02-13 11:31:21 -04:00
root
c1e8e305e1 requests working 2013-02-11 15:10:34 -06:00
Andrew Melton
28b13c8e9f Fixing start_workers.py 2013-01-30 15:56:40 -05:00
Andrew Melton
da5e6765af Refactoring worker and tests 2013-01-29 16:33:30 -05:00
Andrew Melton
5243cbc24e Queue args in deployment config, worker tests 2013-01-28 17:44:54 -05:00
Andrew Melton
b788ebafa2 Worker unit tests 2013-01-25 18:17:18 -05:00
Andrew Melton
9b3c4ef735 Reverting a few temporary changes to worker files 2013-01-25 16:04:24 -05:00
Andrew Melton
0378e26f91 Initial usage parser work 2013-01-25 16:02:52 -05:00
Sandy Walsh
bc12461afe Merge pull request #14 from rackspace/kpi 
KPI - Time from Request to Action Completion
 2012-11-19 08:01:05 -08:00
Sandy Walsh
03c5a51527 fixed up a bunch of little gotchas. kpi working 2012-11-19 11:14:52 -04:00
Sandy Walsh
984211484d ugh, messed up the merge 2012-11-07 12:55:46 -04:00
Matt Thompson
ff6701c9e1 Don't source stacktach_config.sh since we're no longer using that 2012-11-07 16:37:06 +00:00
Sandy Walsh
86ac2657ad start_workers checks local_settings file 2012-11-07 12:23:33 -04:00
Sandy Walsh
635349b1f0 better logging, stem the worker memory leaks and fix up the start script 2012-11-07 10:11:04 -04:00
Sandy Walsh
fa4448174f better logging, stem the worker memory leaks and fix up the start script 2012-11-07 10:01:57 -04:00
Sandy Walsh
87f58e982c db host config, summary fix, durable queues 2012-11-05 11:02:16 -04:00