Commit Graph

19 Commits

Author SHA1 Message Date
nuluh
58a672a680 fix(data): Fix generate_df_tuples function output bug when special_groups args is passed 2025-06-17 13:20:27 +07:00
nuluh
24c1484300 feat(data): Enhance DataProcessor to support dynamic base path and improve data loading with error handling and memory efficiency 2025-06-16 17:35:27 +07:00
nuluh
60ff4e0fa9 feat(data): Propose new damage file index generation to improve structure and flexibility in DataFrame handling 2025-06-16 03:13:07 +07:00
nuluh
3e652accfb refactor(data): remove unnecessary variable declaration in DataProcessor for loading dataframes 2025-06-14 04:02:42 +07:00
nuluh
66a09e0ddf feat(data): Enhance damage file index generation with undamaged file handling and improved error management (WIP) 2025-06-14 04:02:42 +07:00
nuluh
195f8143f0 refactor(data): remove redundant column extraction method and simplify dataframe loading 2025-06-14 00:57:54 +07:00
nuluh
ebaa263781 chore(convert): comment out create_damage_files obsolete function 2025-06-09 18:59:51 +07:00
nuluh
36b36c41ba feat(data): add export_to_csv method for saving processed data into individuals sensor end and update test script
Closes #40
2025-04-17 10:10:19 +07:00
nuluh
ff64f3a3ab refactor(data): update type annotations for damage files index and related classes. Need better implementation 2025-03-22 19:48:50 +07:00
nuluh
58a316d9c8 feat(data): implement damage files index generation and data processing
Closes #38
2025-03-21 15:58:50 +07:00
nuluh
35e25ba4c6 fix(data): ensure output directories are created before saving files
Closes #35
2025-03-16 18:30:52 +07:00
nuluh
c8653f53ea fix(data): update output file naming to include customizable prefix 2025-03-16 13:58:50 +07:00
nuluh
c28e79b022 feat(convert): add prefix parameter to create_damage_files for customizable file naming
Closes #31
2025-03-16 10:57:13 +07:00
nuluh
a1fbe8bd93 feat(convert): Update damage scenarios and output file naming conventions 2024-12-08 18:08:59 +07:00
nuluh
ff5578652f fix(script): Fix bugs taking incorrect column by changing columns and sensor_end_map index number to take the loop of enumeration. 2024-09-03 12:08:53 +07:00
nuluh
db2c5d3a4e feat(script): Update output directory in convert.py 2024-09-03 11:50:44 +07:00
nuluh
ea978de872 - 2024-09-03 11:43:46 +07:00
nuluh
465d257850 feat(script): Add zero-padding to converted CSV filenames for standardize processing pipeline 2024-09-03 11:38:49 +07:00
nuluh
d12eea0acf feat(data-processing): Implement CSV data transformation for SVM analysis
Introduce a Python script for transforming QUGS 2D grid structure data into a simplified 1D beam format suitable for SVM-based damage detection. The script efficiently slices original CSV files into smaller, manageable sets, correlating specific damage scenarios with their corresponding sensor data. This change addresses the challenge of retaining critical damage localization information during the data conversion process, ensuring high-quality, relevant data for 1D analysis.

Closes #20
2024-09-03 11:33:23 +07:00