339 Commits

Author SHA1 Message Date
Thiago da Silva
12c675ab27 Update dev_guide.md 2014-07-31 13:13:00 -04:00
Thiago da Silva
c70faa4e27 Update quick_start_guide.md 2014-07-31 10:40:14 -04:00
Thiago da Silva
91b8b2cf7a Update quick_start_guide.md 2014-07-31 10:37:54 -04:00
Thiago da Silva
f8fbe046f8 Update README.md 2014-07-31 10:13:53 -04:00
Thiago da Silva
8a7e143127 Merge pull request #21 from pushpesh/quickstartguide
Quickstartguide
2014-07-31 10:10:10 -04:00
Thiago da Silva
45573bd18c Merge pull request #27 from thiagol11/cleanup_db_after_functest
Cleanup db after functest
2014-07-29 11:51:16 -04:00
Thiago da Silva
408ad0f047 Merge branch 'cleanup_db_after_functest' of github.com:thiagol11/swiftonfile into cleanup_db_after_functest
Conflicts:
	test/functional/__init__.py
2014-07-24 21:14:43 -04:00
Thiago da Silva
3ba8ce2700 added comment to code change
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-24 21:11:22 -04:00
Thiago da Silva
d567111103 clean up saio env after running func tests
Current tests from upstream swift leave containers in the
database after they are done running.

This causes an issue with sof tests because we clean up the
tests directory /mnt/swiftonfile. When running the
functional tests a second time always fails because the
setup functions tries to delete existing containers,
but the sof object servers returns 404, thus causing
the whole test to fail.

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-24 21:09:22 -04:00
Thiago da Silva
72eb3be6d2 Revert "fix functional tests to cleanup containers"
This reverts commit 8608b5e816031eb072bc95fce59a7b30d8e3496a.
2014-07-24 21:09:22 -04:00
Thiago da Silva
09affa3951 fix functional tests to cleanup containers
Current tests from upstream swift leave containers in the
database after they are done running.

This causes an issue with sof tests because we clean up the
tests directory /mnt/swiftonfile. When running the
functional tests a second time always fails because the
setup functions tries to delete existing containers,
but the sof object servers returns 404, thus causing
the whole test to fail.

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-24 21:09:22 -04:00
Thiago da Silva
db257f8826 Merge pull request #26 from thiagol11/remove_keystoneclient_dependency
remove keystone client dependency
2014-07-24 16:25:01 -04:00
Thiago da Silva
00128524c1 remove keystone client dependency
this dependency is no longer needed

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-24 16:16:26 -04:00
Pushpesh Sharma
8bf1d6bb69 Minor Update 2014-07-18 14:09:21 +05:30
Pushpesh Sharma
581e6145f0 Minor Update 2014-07-18 13:46:00 +05:30
Pushpesh Sharma
01abe7dc68 Minor updates 2014-07-18 13:10:24 +05:30
Pushpesh Sharma
1cdc18e93d Included suggestions 2014-07-15 16:43:37 +05:30
Thiago da Silva
068f6000e9 clean up saio env after running func tests
Current tests from upstream swift leave containers in the
database after they are done running.

This causes an issue with sof tests because we clean up the
tests directory /mnt/swiftonfile. When running the
functional tests a second time always fails because the
setup functions tries to delete existing containers,
but the sof object servers returns 404, thus causing
the whole test to fail.

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-11 15:06:58 -04:00
Thiago da Silva
eeb164ac2d Revert "fix functional tests to cleanup containers"
This reverts commit 8608b5e816031eb072bc95fce59a7b30d8e3496a.
2014-07-11 15:02:55 -04:00
Thiago da Silva
0e1fa13a63 Merge pull request #25 from thiagol11/remove_unused_files
removing unused files
2014-07-11 11:01:55 -04:00
Thiago da Silva
8608b5e816 fix functional tests to cleanup containers
Current tests from upstream swift leave containers in the
database after they are done running.

This causes an issue with sof tests because we clean up the
tests directory /mnt/swiftonfile. When running the
functional tests a second time always fails because the
setup functions tries to delete existing containers,
but the sof object servers returns 404, thus causing
the whole test to fail.

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-10 15:37:08 -04:00
Thiago da Silva
16b7d16803 removing unused files
These files are no long in use by swiftonfile.
- functional_auth/tempauth files are no longer required because
tests now rely on a saio setup where tempauth is already used
by default.
- tools/functional_tests.sh has been replaced by .functests.
- tools/tox_run.sh is no longer required, but swiftonfile now requires
a saio setup and swiftonfile to be configured as a storage policy
for testing.
- test/unit/common/data/* files are also no longer in use.

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-09 08:54:56 -04:00
Thiago da Silva
5fbc81f25f Merge pull request #24 from thiagol11/sof_name_change
changing references of gluster to swiftonfile
2014-07-09 08:40:04 -04:00
Thiago da Silva
81734f62f8 fix unit test reference to gluster.swift
Changed it to swiftonfile.swift.

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-08 11:18:16 -04:00
Thiago da Silva
a314f8825f Merge branch 'sof_name_change' of github.com:thiagol11/swiftonfile into sof_name_change 2014-07-08 11:07:55 -04:00
Thiago da Silva
27fe040c3b changes references to swiftonfile in tests scripts
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-08 11:04:31 -04:00
Thiago da Silva
de24352275 changing references of gluster to swiftonfile
Renamed files and directories as well as replaced
infile references to gluster where appropriate

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-08 11:04:31 -04:00
Thiago da Silva
67c77c1be9 Merge pull request #14 from prashanthpai/unlink-log
Fix unlink call after successful rename
2014-07-07 15:17:24 -04:00
Thiago da Silva
51c14cc0f0 changes references to swiftonfile in tests scripts
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-07 13:47:32 -04:00
Thiago da Silva
3fbd438887 changing references of gluster to swiftonfile
Renamed files and directories as well as replaced
infile references to gluster where appropriate

Signed-off-by: Thiago da Silva <thiago@redhat.com>
2014-07-07 13:33:40 -04:00
Prashanth Pai
5fe3970027 Fix unlink call after successful rename
This used to appear for every PUT of an object.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-07-07 14:49:45 +05:30
Thiago da Silva
89c8ec0ef7 Merge pull request #19 from prashanthpai/sp-cleanup
Support for Storage Policies
2014-07-01 14:41:27 -04:00
Prashanth Pai
e5d939bdce Support Storage Policy - Rev 8
* Added a version of .functests script that does not replace existing
  SAIO conf files and rings. This expects the appropriate setup to be
  ready before running functional tests.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-26 17:38:02 +05:30
Pushpesh Sharma
873ff534c5 Minor update 2014-06-26 16:56:38 +05:30
Pushpesh Sharma
71228826b9 SwiftOnFile as StoragePolicy of OpenStack Swift
Done necessary changes to quick start guide.This
guide suggest easy steps to extend swift SAIO setup
to use swiftonfile as storage policy.
2014-06-26 16:28:51 +05:30
Prashanth Pai
50067f9c69 Support Storage Policy - Rev 7
* Rename references of '/mnt/gluster-object' to '/mnt/swiftonfile'.
* Rename swiftonfile SP name from 'sof' to 'swiftonfile'.
* Retain reseller_prefix in account dir created. This is to comply
  with Swift's behavior.
* Cleanup mountpoint after running swiftonfile specific tests.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-24 14:44:31 +05:30
Prashanth Pai
285aece1ee Support Storage Policy - Rev 6
Disable auto mounting of glusterfs volume by object-server.
Glusterfs.py now mostly contains dead code that is never called.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 15:16:14 +05:30
Prashanth Pai
8ea7bd718d Support Storage Policy - Rev 5
* Sync to Swift 2.0.0rc1 release.
* Use separate conf files for functional tests
* Define swiftonfile as policy with index 2

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 15:08:35 +05:30
Prashanth Pai
d91e33a0f4 Support Storage Policy - Rev 4
Added Swift On File specific functional tests that checks SoF's
object naming convention by comparing names of objects PUT and
actual files found over mountpoint.

Remove old reference to keystone functional tests.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 12:22:43 +05:30
Prashanth Pai
abf0641e40 Support Storage Policy - Rev 3
* Functional tests now run in SAIO+SoF setup.
* Fix and update various constraints.
* Update object-server.conf, swift.conf files. Add test.conf file.
* Added ./.functests script

TODO:
* Reintroduce gluster_swift_tests.py with SoF
  specific functional tests.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 12:22:43 +05:30
Prashanth Pai
33e8e2312e Support Storage Policy - Rev 2
* Fix API inconsistencies
* Remove hard-coded reseller_prefix = AUTH_
* Remove unused methods from gluster/swift/common/utils.py
  These used to be called from DiskDir earlier.
* Remove hidden configuration option that were related to account
  and container listings and metadata.
* Remove unused and redundant attributes

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 12:22:42 +05:30
Prashanth Pai
7ab8e35ff6 Support Storage Policy - Rev 1
* Inherit DiskFileMananger class and few other methods from Swift
  and reuse them.
* Unit tests for write_pickle method.
* Added policy_idx args, wherever missing.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 12:22:42 +05:30
Prashanth Pai
3f4d0f98de Support Storage Policy
* The file path on mountpoint was /container/obj and has been changed to
  /account/container/obj. This structure is not created on account and
  container creation but rather during the first object PUT to that
  container.
* Rename OnDiskManager class to DiskFileManager
* Remove overridden container_update() method and use Swift's default
  implementation that updates container DB.
* Add support for async_dir in storage policies - failed database
  updates are stored in these directories to be later picked up by
  object-updater daemon. This change reintroduced write_pickle and
  pickle_async_update methods which are slightly modified versions
  of Swift's methods of the same name.
* Updated tox.ini dependency on Swift to point to feature/ec branch of
  Swift's github repo.

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 12:22:42 +05:30
Prashanth Pai
ba39ade716 Remove non SP related code
This commit only removes code that is not required when swiftonfile
will be used as Storage Policy in Swift.

This commit does NOT:
* include code changes to support SP
* fix functional tests
* update documentation related to SP

This commit removes the following:
* Gen builders script and its man page.
* Authentication guide, user guide and other docs.
* Swiftkerbauth code, unit tests, func tests and doc.
* gswauth code, unit tests, func tests and doc.
* Object expirer code modifications, unit tests and doc.
* Conf files of account, container, proxy.
* Account, container and proxy server code - server.py of each.
* Account, container and proxy unit and functional tests.
* DiskDir class and corresponding unit tests.
* Our overridden ring.py (enforces account = volume = device) and tests.
* Functional tests for authentication filters.
* modules/swift and test/deploy directories.
* Proxy base controllers unit tests.

NOTE: We may have to reintroduce some of the above functional and unit
tests after SP related code changes - during fixing functional tests.

This commit modifies:
* setup.py to reflect the above code removals.
* constraints.py to remove references to ring.py
* object server.py to remove object-expirer changes
* tox.ini to remove ksfunctest and swfunctest

Signed-off-by: Prashanth Pai <ppai@redhat.com>
2014-06-23 12:22:42 +05:30
Thiago da Silva
9f3687bc66 Merge pull request #23 from thiagol11/master
adding sentence on consuming existing data
2014-05-28 16:55:45 -04:00
Thiago da Silva
16120ec614 adding sentence on consuming existing data
Calling out the fact that with SoF, users would be able to add existing file storage to a swift cluster and expose those files as objects.
2014-05-28 16:44:00 -04:00
Thiago da Silva
4f65c3cf02 remove reference to fedora 19 2014-05-28 16:13:16 -04:00
Thiago da Silva
b639f37990 Merge pull request #10 from pushpesh/devguide
Dev_guide updated with github workflow
2014-05-28 16:11:12 -04:00
Thiago da Silva
7151a9a9e0 fixed some wording on the example paragraph 2014-05-28 16:00:51 -04:00
Thiago da Silva
048ccc0bca Merge pull request #22 from thiagol11/project_roadmap
Project roadmap
2014-05-28 15:58:06 -04:00