Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added an example within the documentation for custom readers supporting pandas DataFrames. #707

Merged
merged 25 commits into from
Mar 8, 2023

Commits on Aug 31, 2022

  1. Added a new example within the documentation in docs/examples for the…

    … definition of custom Readers that support pandas DataFrames. This has the benefit of being able to take advantage of the range of data formats that pandas supports for ground truth and detection data being read into stonesoup. The example includes the custom definition of a DataFrameGroundTruthReader and DataFrameDetectionReader class. Both of these inherit from the GroundTruthReader class, along with a custom defined _DataFrameReader class. Each of these classes supports reading of pandas dataframes that are already read into memory, in a similar way to the CSVGroundTruthReader and CSVDetectionReader [issue 354].
    BenjaminFraser committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    435883a View commit details
    Browse the repository at this point in the history
  2. Added pandas as a dependency to setup.py, under extras_require['dev']…

    …, ref pull request dstl#707 failing to build docs.
    BenjaminFraser committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    15e2bef View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2022

  1. Configuration menu
    Copy the full SHA
    c77e80e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    775161f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9c31b1e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cc9bbd7 View commit details
    Browse the repository at this point in the history
  5. Updated references to Stone Soup throughout documentation to be two-w…

    …ord, for consistency with the remainder of all Stone Soup documentation.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    b5e72c9 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    8295311 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    1b50fee View commit details
    Browse the repository at this point in the history
  8. Added support for fields that are already in DateTime format within _…

    …DataFrameReader, as suggested by sdhiscocks.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    2db60ee View commit details
    Browse the repository at this point in the history
  9. Added new pandas readers to reader directory within new file 'pandas_…

    …reader.py'. This includes a new _DataFrameReader class, which inherits from Reader and allows a Pandas DataFrame to be read. Two new classes are also developed for reading ground-truth data from pandas (DataFrameGroundTruthReader) and reading detections from pandas (DataFrameDetectionReader). Each of these new classes inherit from DetectionReader and _DataFrameReader, and yield outputs in the same way as the basic GroundTruthReader (yields previous time and updated_paths) and DetectionReader (yields previous time and detections) classes within Stone Soup. Tests are still to be generated for these classes.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    9fb4eaf View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    776a3cc View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    33cb12a View commit details
    Browse the repository at this point in the history
  12. Added import modf from math standard library, as required for functio…

    …ns within both Custom_Pandas_Dataloader.py (documents example), and reader/pandas_reader.py.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    3f2dd7b View commit details
    Browse the repository at this point in the history
  13. Added Detection import from stonesoup types.detection as required wit…

    …hin both Custom_Pandas_Dataloader.py (documents example), and reader/pandas_reader.py.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    20b9417 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    95d7ee2 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    ea8f82b View commit details
    Browse the repository at this point in the history
  16. Corrected issues with tests for pandas_reader.py within reader direct…

    …ory. Tests now check both ground-truth reader and detection reader functionality.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    0a53b39 View commit details
    Browse the repository at this point in the history
  17. Improved tests for pandas_reader.py within stonesoup/reader/tests dir…

    …ectory. Now includes seperate tests for DataFrameGroundTruthReader and DataFrameDetectionReader.
    BenjaminFraser committed Oct 22, 2022
    Configuration menu
    Copy the full SHA
    a838e0c View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    21337ef View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    f4786d8 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    8705dac View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2022

  1. Added additional tests to include full coverage of classes defined in…

    … pandas_reader.py. Developed the same tests as defined within test_generic.py.
    BenjaminFraser committed Oct 23, 2022
    Configuration menu
    Copy the full SHA
    90d2c96 View commit details
    Browse the repository at this point in the history
  2. Added further tweak to test_gt_df_multi_per_timestep() test within te…

    …st_pandas_reader.py to check for case where pandas column contains string formatted datetimes, rather than being Timestamp (already formatted in pandas before creating reader).
    BenjaminFraser committed Oct 23, 2022
    Configuration menu
    Copy the full SHA
    af4c77b View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2023

  1. Configuration menu
    Copy the full SHA
    bd854e4 View commit details
    Browse the repository at this point in the history