76 Commits

Author SHA1 Message Date
Jenkins
b6235230ec Merge "RM8278: Fixed glance_usage_audit report" 2014-08-13 18:25:56 +00:00
Manali Latkar
4ea5a86036 RM8278: Fixed glance_usage_audit report
1.Fixed unpacking values bug.
2.Corrected audit period from 86399.000001 to 86400 so that it
picks up correct status counts.

Change-Id: Ieea1f451e6db72aaa6d83696134986a0288bedb1
2014-08-12 16:04:23 +05:30
Manali Latkar
7d77f59478 handling the exception in case no instanceusage with specific instance and launched_at is present
Change-Id: I7eb6d0b76aa41b0f26ab4b81fe033ddd527fc331
2014-08-11 16:38:49 +05:30
Anuj Mathur
bea3a75a35 Nova usage report fix
Gracefully handled case where rawdata entry does
not exist for request_id while generating nova usage
audit report.

Change-Id: I675b2b5e9c4be70d45fc2385f1b448c159610f56
2014-05-30 17:03:54 +05:30
Priyanka Agrawal
655d9acf0a Added try catch for request_id null
When the request_id is null, there was an exception generated.
Currently setting the deployment to None for the reports
in case the request_id is null

Change-Id: Idde2178d217ac16f1b3e275c730e3fce68ba9f1b
2014-05-27 12:31:03 +05:30
Sandy Walsh
8a0f06ac79 Freshen up with latest from RackerLabs (and include tox.ini)
Added instance hours report

Initial version of report to calculate unit hours used
for nova instances

Breakdown by flavor, flavor class, account/billing types and by tenant.

Moved license so script has shebang as the first line
Add tenant info cache.
Refactor Instance hr report.
Added cache table for basic tenant info for reports.
Refactor instance_hours report to use table.
Improve performance of tenant info update.

use bulk sql operations to speed up the tenant info update,
as it's taking ~40s/1000 tenants to update on a decent machine.

Fix some tests broken by rebase. Fix unittests broken by
rebase. Also, renumber migration due to collision.

Add Apache license header to new files.

Fixed bug with fetching deployment information in
reconciler. Reverted old method for fetching
current usage's deployment and added new method to
fetch latest deployment information for
a request_id.

Made the field mismatch error message more readable
Refactored nova and glance verifier tests

the exists are updated with 201 send_status as part of stacktach down repair mechanism

Revert "Fixed bug with fetching deployment information in"

Revert "Adding host and deployment info to missing exists entries in the nova usage audit"

Revert "Added column headers for host and deployment in json reports"

Only log ERROR on last retry

fixed the wrong status name for sent_failed variable in audit report

fixing documentation for urls that are not available for glance

deprecating stacky urls (usage, deletes, exists) that are not
used anymore

Revert "Revert "Added column headers for host and deployment in json reports""

Revert "Revert "Adding host and deployment info to missing exists entries in the nova usage audit""

Revert "Revert "Fixed bug with fetching deployment information in""

Cell and compute info added for verification failures as well.
If that is not present(request_id is not populated for an
InstanceUsage entry), the cells display '-'

Add tox support for move to stackforge

Add tox support for move to stackforge

Change-Id: Id94c2a7f1f9061e972e90c3f54e39c9dec11943b
2014-05-08 15:58:03 -03:00
Sandy Walsh
eae07eecac Switched to Apache licensing 2014-03-28 11:47:16 -03:00
Anuj Mathur
00bcb90117 Added column headers for host and deployment in json reports 2014-03-28 11:09:42 +05:30
Manali Latkar
60be387b97 Adding host and deployment info to missing exists entries in the nova usage audit 2014-03-24 15:31:44 +05:30
Andrew Melton
670396fce0 Remove custom name for ums query based report 2014-03-06 11:48:12 -05:00
Andrew Melton
f0e5b243c6 Using partial instead of defining a new func 2014-03-05 14:34:34 -05:00
Andrew Melton
8bae0d4cfc Refactor verifier audit functions 2014-03-05 14:25:04 -05:00
Andrew Melton
a5d4836e12 Pulling UMS fencepost offset into script argument 2014-03-05 14:04:42 -05:00
Andrew Melton
d8c382744d Adding ums query option to nova usage report 2014-03-05 13:44:46 -05:00
Manali Latkar
cdff368be0 adding the new status counts to usage audit 2013-12-20 12:17:21 +05:30
Andrew Melton
214da88968 Creating parent logger for usage audit 2013-11-10 20:16:26 -05:00
Andrew Melton
6680996675 Merge branch 'master' of git://github.com/rackerlabs/stacktach 2013-11-06 14:20:48 -05:00
Andrew Melton
4109dfcc40 Adding reconciled send_status back 2013-11-06 11:34:19 -05:00
Souvik Basu
623d20c831 add report to get image events count 2013-11-06 19:10:13 +05:30
Manali Latkar
be06dbff8c correcting the old_launches query to the optimized one 2013-11-04 11:41:38 +05:30
Manali Latkar
b76e245c12 incorporated the review changes and optimized the old_images_query 2013-11-04 11:41:38 +05:30
Manali Latkar
59ee803c81 glance_usage_audit.py gives the summary of all exists within audit period along with details of failed exists. Some refactoring in nova_usage_audit is also included. 2013-11-04 11:41:38 +05:30
Shantanu Tushar
8d5415442d the audit period ending should also take into account the value at exact midnight.
This makes the script account for periodic exists events that are stored exactly at midnight.
2013-10-08 07:25:36 +00:00
Andrew Melton
5d6d030c5f Merge pull request #214 from ramielrowe/reconciled_status_report
Adding reconciled send_status to usage report
2013-10-07 07:07:35 -07:00
Andrew Melton
9bdde6d385 Adding reconciled send_status to usage report 2013-10-03 13:14:06 -04:00
Souvik Basu
0399f2baf2 Added bandwidth_public_out field to stacktach.instanceexists table.
Public Outbound Bandwidth info is picked up from nova exists notification
and inserted into stacktach.instanceexists table.
2013-09-17 16:17:28 +05:30
Thomas Maddox
dfb5916833 small tweak 2013-09-13 11:25:32 -05:00
Thomas Maddox
1c8afed7aa fixed request_id and added to pretty.py as well 2013-09-13 11:08:34 -05:00
Andrew Melton
3441f58ba2 Excluding exists from error_details instance requests query 2013-09-13 11:00:14 -04:00
Andrew Melton
d10409b81e Optimizing requests for uuid query in error detail 2013-09-13 10:54:44 -04:00
Andrew Melton
9d6886506c Accounting for reconciled old launches in nova audit report 2013-09-10 15:25:58 -04:00
Andrew Melton
0f137040ac More efficient old launches query 2013-08-13 14:29:19 -04:00
Andrew Melton
d17e7eef88 Logging and more obvious match failures 2013-07-11 15:08:36 -04:00
Andrew Melton
c3c1412cf2 Test coverage and V4 of Nova Usage Audit 2013-07-09 11:42:21 -04:00
Andrew Melton
c5842e2a7b Bumping nova_usage_audit report version 2013-07-02 14:36:33 -04:00
Andrew Melton
cb65528d95 Adding reconciler to auditor 2013-06-24 21:23:49 +00:00
Thomas Maddox
93a0723544 clean up 2013-06-21 13:08:03 -05:00
Thomas Maddox
8ecd7a4a81 removed notification dive 2013-06-20 11:07:43 -05:00
Thomas Maddox
6676e85c0f Changed to use image_type bit field to determine os_type 2013-06-20 09:58:40 -05:00
Thomas Maddox
c74bd48a48 first checkin for os_type; grabbing from notification json 2013-06-20 09:56:06 -05:00
Andrew Melton
0aef1307b9 Audit verifier results by timestamp instead of period 2013-06-18 13:54:40 -04:00
Andrew Melton
dc5f5f12e6 Adding verifier detail to audit report 2013-06-07 14:53:02 -04:00
Thomas Maddox
5a66d34377 removed prints to console 2013-05-31 13:57:02 -05:00
Thomas Maddox
c43f4219ac Set to store summaries as metadata in DB 2013-05-31 13:57:02 -05:00
Thomas Maddox
5178b80374 formatting fixes 2013-05-31 13:57:02 -05:00
Thomas Maddox
18ad73193d changed to tuple for REGEX configuration 2013-05-31 13:57:01 -05:00
Thomas Maddox
b5acccee1c first check in for exception/event counts 2013-05-31 13:57:01 -05:00
Thomas Maddox
417df627ea rsp() changes and PEP8 formatting 2013-04-30 16:23:10 -05:00
Thomas Maddox
bc4a3f6942 fixes from review comments 2013-04-29 16:09:27 -05:00
Thomas Maddox
ffb2074ee0 removed user directory resolve for stacktach install dir 2013-04-29 13:18:32 -05:00