Commit Graph

74 Commits

Author SHA1 Message Date
nuluh
cba4a00cd8 feat(src): implement working function for dataset B to create ready data from STFT files stft_files and add setup.py for package configuration 2025-04-24 09:32:22 +07:00
nuluh
90a5a76609 wip: add function to create stratified train-test split from STFT data 2025-04-23 12:48:15 +07:00
nuluh
c8509aa728 fix(notebooks): fix out of index stft plotting iteration 2025-04-22 10:55:34 +07:00
nuluh
4ebfb52635 Merge branch '40-feat-add-export-to-csv-method-for-dataprocessor-in-convertpy' 2025-04-21 00:16:39 +07:00
nuluh
cb380219f9 test(notebooks): update file paths for sensor data loading and add markdown for clarity 2025-04-21 00:07:06 +07:00
nuluh
804c178175 fix(notebooks): remove erroneous line and add markdown for testing outside training data 2025-04-20 16:32:31 +07:00
nuluh
1511012e11 refactor(test): update test script to generate damage files index for dataset_B and adjust export path for processed data 2025-04-20 16:02:16 +07:00
nuluh
db2947abdf fix(data): fix the incorrect output of scipy.stft() data to be pandas.DataFrame shaped (513,513) along with its frequencies as the index and times as the columns (transposed) instead of just the magnitude that being flattened out; add checks for empty data and correct file paths for sensor data loading.
Closes #43
2025-04-20 14:45:38 +07:00
nuluh
36b36c41ba feat(data): add export_to_csv method for saving processed data into individuals sensor end and update test script
Closes #40
2025-04-17 10:10:19 +07:00
Rifqi D. Panuluh
28681017ad Merge pull request #39 from nuluh/feature/38-feat-redesign-convertpy
Feature/38 feat redesign `convert.py`
2025-03-22 19:57:20 +07:00
nuluh
ff64f3a3ab refactor(data): update type annotations for damage files index and related classes. Need better implementation 2025-03-22 19:48:50 +07:00
nuluh
58a316d9c8 feat(data): implement damage files index generation and data processing
Closes #38
2025-03-21 15:58:50 +07:00
Rifqi D. Panuluh
020028eed8 Merge pull request #36 from nuluh/35-bug-oserror-for-non-existent-folder-when-running-convertpy
fix(data): ensure output directories are created before saving files
2025-03-16 18:45:36 +07:00
nuluh
35e25ba4c6 fix(data): ensure output directories are created before saving files
Closes #35
2025-03-16 18:30:52 +07:00
nuluh
8ed1437d6d Merge branch 'main' of https://github.com/nuluh/thesis 2025-03-16 14:12:11 +07:00
nuluh
96556a1186 ```
No code changes detected.
```
2025-03-16 14:07:56 +07:00
Rifqi D. Panuluh
0a63aab211 Merge pull request #34 from nuluh/stft
fix(data): update output file naming to include customizable prefix
2025-03-16 14:01:58 +07:00
nuluh
c8653f53ea fix(data): update output file naming to include customizable prefix 2025-03-16 13:58:50 +07:00
Rifqi D. Panuluh
48ea879863 Create documentation.yml 2025-03-16 12:39:10 +07:00
Rifqi D. Panuluh
69afdb1ad1 Create experiment.yml 2025-03-16 12:38:41 +07:00
Rifqi D. Panuluh
db2d9299e6 Create feature_request.yml 2025-03-16 12:38:14 +07:00
Rifqi D. Panuluh
d5ba1ac0cd Create bug_report.yml 2025-03-16 12:37:38 +07:00
Rifqi D. Panuluh
144f406226 Create config.yml 2025-03-16 12:36:46 +07:00
Rifqi D. Panuluh
e6f8820989 Merge pull request #33 from nuluh/stft
chore: add .gitattributes and .gitmessage for commit message guidelines
2025-03-16 12:17:55 +07:00
nuluh
59aa124305 chore: add .gitattributes and .gitmessage for commit message guidelines 2025-03-16 12:16:23 +07:00
Rifqi D. Panuluh
2de04a6ea6 Create CONTRIBUTING.md 2025-03-16 12:02:35 +07:00
Rifqi D. Panuluh
48075a590e Merge pull request #32 from nuluh/stft
Stft
2025-03-16 11:49:44 +07:00
nuluh
c28e79b022 feat(convert): add prefix parameter to create_damage_files for customizable file naming
Closes #31
2025-03-16 10:57:13 +07:00
nuluh
b890e556cf fix(notebook): correct execution counts and update file naming conventions for STFT processing
Closes #27
2025-03-11 19:08:56 +07:00
nuluh
fa6e1ff72b refactor(notebook): seperate process_stft function to individual code cell. 2025-03-08 11:04:37 +07:00
nuluh
a2e339a0a0 feat: Implement STFT verification for individual test runs against aggregated data 2024-12-13 16:30:06 +07:00
nuluh
2decff0cfb Closes #24
feat(stft): Implement STFT processing for vibration data with multiprocessing support to include all the data for training process instead of just using `TEST1` only
2024-12-13 16:29:08 +07:00
nuluh
8b4eedab8a Closes #26
feat: Specify `fs` when calling `scipy.signal.stft`
2024-12-09 00:49:25 +07:00
nuluh
a1fbe8bd93 feat(convert): Update damage scenarios and output file naming conventions 2024-12-08 18:08:59 +07:00
nuluh
832b6c49db feat(notebook): Implement STFT with Hann windowing. Closes #22 2024-10-21 19:08:46 +07:00
nuluh
9618714d3c feat: Prepare all damage cases vibration record data to be merged inside two variables "signal_sensor1" and "signal_sensor2". Closes #23 2024-10-19 15:32:05 +07:00
Rifqi D. Panuluh
b229967e05 Update README.md 2024-09-09 23:14:01 +07:00
Rifqi D. Panuluh
f41edaaa91 Update README.md 2024-09-09 23:13:03 +07:00
Panuluh
e9c06e1ac1 Update LICENSE 2024-09-07 09:13:57 +07:00
nuluh
2f54e91197 feat: Add absolute value option to time feature extraction 2024-09-03 15:39:44 +07:00
nuluh
758255a24e feat(notebooks): Implement Time-domain feature extraction with real data from QUGS 2024-09-03 12:52:40 +07:00
nuluh
ff5578652f fix(script): Fix bugs taking incorrect column by changing columns and sensor_end_map index number to take the loop of enumeration. 2024-09-03 12:08:53 +07:00
nuluh
db2c5d3a4e feat(script): Update output directory in convert.py 2024-09-03 11:50:44 +07:00
nuluh
ea978de872 - 2024-09-03 11:43:46 +07:00
nuluh
465d257850 feat(script): Add zero-padding to converted CSV filenames for standardize processing pipeline 2024-09-03 11:38:49 +07:00
nuluh
d12eea0acf feat(data-processing): Implement CSV data transformation for SVM analysis
Introduce a Python script for transforming QUGS 2D grid structure data into a simplified 1D beam format suitable for SVM-based damage detection. The script efficiently slices original CSV files into smaller, manageable sets, correlating specific damage scenarios with their corresponding sensor data. This change addresses the challenge of retaining critical damage localization information during the data conversion process, ensuring high-quality, relevant data for 1D analysis.

Closes #20
2024-09-03 11:33:23 +07:00
nuluh
0306f28a68 docs(notebooks): add extract_numbers docstring 2024-09-03 11:09:47 +07:00
Panuluh
9da3dae709 Merge pull request #18 from nuluh/feature/15-normalize-dataset-by-preprocess-relatives-value-between-two-acceloremeter-sensors
Feature/15 normalize dataset by preprocess relatives value between two acceloremeter sensors
2024-09-03 08:43:44 +07:00
nuluh
41086e95ad chore: Ignore .venv/ directory and update .gitignore due to error numpy error ValueError: numpy.ndarray size changed, may indicate binary incompatibility. by creating venv. 2024-09-01 14:50:24 +07:00
nuluh
adde35ed7e feat(notebook): Normalize the data by calculating the relative value between two sensors. Along with it, MinMaxScaler and StandardScaler are applied and visualize with Seaborn's Pair Plot.
Closes #15
2024-09-01 14:50:04 +07:00