DataFinder is a lightweight data management application developed in Python that primarily targets the management of huge data accumulations, often encountered in the scientific field. The system is able to handle large amounts of data and can be easily integrated in existing working environments. It can be optimised to fit any situation by embedding scripts.
The new home of the project is: https:/
Features:
- Organisation of managed data objects within a hierarchical structure
which is determined by a free-definable data model
o Standardises and restricts data structure
o Defines required and optional meta data of collections and imported data files
- Import of data files into different storage locations
o Support of standardised file transfer mechanisms, e.g., WebDAV, POSIX
o Flexible configuration to fit the available infrastructure
o Persistence layer can be easily extended by further file transfer mechanisms
- Archival of managed data using Tivoli Storage Manager as storage back end
- Support of standard file browser features, e.g. copying, moving, deletion, ...
- Support of symbolic links on data objects and collections
- Support of complex search queries based upon meta data
- Platform-
o Customisable user client supporting data management tasks
o Administrative client supporting administration tasks,
e.g., configuration of the data model and storage locations
- Access to managed data via a Python API
Project information
- Maintainer:
- DataFinderTeam
- Driver:
- DataFinderTeam
- Licence:
- Simplified BSD Licence
View full history Series and milestones
trunk series is the current focus of development.
All code Code
- Version control system:
- Bazaar
- Programming languages:
- Python 2.6
All questions Latest questions
All bugs Latest bugs reported
-
Bug #1370471: Add support to determine available disk space of a data store.
Reported -
Bug #1370095: Allow re-use of meta data credentials to authenticate at a FTP store.
Reported -
Bug #1368777: The default privileges when creating directories/files with the SDTP store needs to be improved.
Reported -
Bug #1309074: Problems with renaming of a file or directory.
Reported -
Bug #1306483: JSON String deserialisation of Datetime objects fails with Python 2.7
Reported
All blueprints Latest blueprints
-
Integration of a full text search using Lucene.
Registered -
Signing data for validity
Registered -
New administrative GUI
Registered -
Adapting data management user interface to PySide
Registered -
Improving the user interfaces usability
Registered