Rifqi D. Panuluh
020028eed8
Merge pull request #36 from nuluh/35-bug-oserror-for-non-existent-folder-when-running-convertpy
...
fix(data): ensure output directories are created before saving files
2025-03-16 18:45:36 +07:00
nuluh
35e25ba4c6
fix(data): ensure output directories are created before saving files
...
Closes #35
2025-03-16 18:30:52 +07:00
nuluh
8ed1437d6d
Merge branch 'main' of https://github.com/nuluh/thesis
2025-03-16 14:12:11 +07:00
nuluh
96556a1186
```
...
No code changes detected.
```
2025-03-16 14:07:56 +07:00
Rifqi D. Panuluh
0a63aab211
Merge pull request #34 from nuluh/stft
...
fix(data): update output file naming to include customizable prefix
2025-03-16 14:01:58 +07:00
nuluh
c8653f53ea
fix(data): update output file naming to include customizable prefix
2025-03-16 13:58:50 +07:00
Rifqi D. Panuluh
48ea879863
Create documentation.yml
2025-03-16 12:39:10 +07:00
Rifqi D. Panuluh
69afdb1ad1
Create experiment.yml
2025-03-16 12:38:41 +07:00
Rifqi D. Panuluh
db2d9299e6
Create feature_request.yml
2025-03-16 12:38:14 +07:00
Rifqi D. Panuluh
d5ba1ac0cd
Create bug_report.yml
2025-03-16 12:37:38 +07:00
Rifqi D. Panuluh
144f406226
Create config.yml
2025-03-16 12:36:46 +07:00
Rifqi D. Panuluh
e6f8820989
Merge pull request #33 from nuluh/stft
...
chore: add .gitattributes and .gitmessage for commit message guidelines
2025-03-16 12:17:55 +07:00
nuluh
59aa124305
chore: add .gitattributes and .gitmessage for commit message guidelines
2025-03-16 12:16:23 +07:00
Rifqi D. Panuluh
2de04a6ea6
Create CONTRIBUTING.md
2025-03-16 12:02:35 +07:00
Rifqi D. Panuluh
48075a590e
Merge pull request #32 from nuluh/stft
...
Stft
2025-03-16 11:49:44 +07:00
nuluh
c28e79b022
feat(convert): add prefix parameter to create_damage_files for customizable file naming
...
Closes #31
2025-03-16 10:57:13 +07:00
nuluh
b890e556cf
fix(notebook): correct execution counts and update file naming conventions for STFT processing
...
Closes #27
2025-03-11 19:08:56 +07:00
nuluh
fa6e1ff72b
refactor(notebook): seperate process_stft function to individual code cell.
2025-03-08 11:04:37 +07:00
nuluh
a2e339a0a0
feat: Implement STFT verification for individual test runs against aggregated data
2024-12-13 16:30:06 +07:00
nuluh
2decff0cfb
Closes #24
...
feat(stft): Implement STFT processing for vibration data with multiprocessing support to include all the data for training process instead of just using `TEST1` only
2024-12-13 16:29:08 +07:00
nuluh
8b4eedab8a
Closes #26
...
feat: Specify `fs` when calling `scipy.signal.stft`
2024-12-09 00:49:25 +07:00
nuluh
a1fbe8bd93
feat(convert): Update damage scenarios and output file naming conventions
2024-12-08 18:08:59 +07:00
nuluh
832b6c49db
feat(notebook): Implement STFT with Hann windowing. Closes #22
2024-10-21 19:08:46 +07:00
nuluh
9618714d3c
feat: Prepare all damage cases vibration record data to be merged inside two variables "signal_sensor1" and "signal_sensor2". Closes #23
2024-10-19 15:32:05 +07:00
Rifqi D. Panuluh
b229967e05
Update README.md
2024-09-09 23:14:01 +07:00
Rifqi D. Panuluh
f41edaaa91
Update README.md
2024-09-09 23:13:03 +07:00
Panuluh
e9c06e1ac1
Update LICENSE
2024-09-07 09:13:57 +07:00
nuluh
2f54e91197
feat: Add absolute value option to time feature extraction
2024-09-03 15:39:44 +07:00
nuluh
758255a24e
feat(notebooks): Implement Time-domain feature extraction with real data from QUGS
2024-09-03 12:52:40 +07:00
nuluh
ff5578652f
fix(script): Fix bugs taking incorrect column by changing columns and sensor_end_map index number to take the loop of enumeration.
2024-09-03 12:08:53 +07:00
nuluh
db2c5d3a4e
feat(script): Update output directory in convert.py
2024-09-03 11:50:44 +07:00
nuluh
ea978de872
-
2024-09-03 11:43:46 +07:00
nuluh
465d257850
feat(script): Add zero-padding to converted CSV filenames for standardize processing pipeline
2024-09-03 11:38:49 +07:00
nuluh
d12eea0acf
feat(data-processing): Implement CSV data transformation for SVM analysis
...
Introduce a Python script for transforming QUGS 2D grid structure data into a simplified 1D beam format suitable for SVM-based damage detection. The script efficiently slices original CSV files into smaller, manageable sets, correlating specific damage scenarios with their corresponding sensor data. This change addresses the challenge of retaining critical damage localization information during the data conversion process, ensuring high-quality, relevant data for 1D analysis.
Closes #20
2024-09-03 11:33:23 +07:00
nuluh
0306f28a68
docs(notebooks): add extract_numbers docstring
2024-09-03 11:09:47 +07:00
Panuluh
9da3dae709
Merge pull request #18 from nuluh/feature/15-normalize-dataset-by-preprocess-relatives-value-between-two-acceloremeter-sensors
...
Feature/15 normalize dataset by preprocess relatives value between two acceloremeter sensors
2024-09-03 08:43:44 +07:00
nuluh
41086e95ad
chore: Ignore .venv/ directory and update .gitignore due to error numpy error ValueError: numpy.ndarray size changed, may indicate binary incompatibility. by creating venv.
2024-09-01 14:50:24 +07:00
nuluh
adde35ed7e
feat(notebook): Normalize the data by calculating the relative value between two sensors. Along with it, MinMaxScaler and StandardScaler are applied and visualize with Seaborn's Pair Plot.
...
Closes #15
2024-09-01 14:50:04 +07:00
nuluh
b2684c23f6
feat(script): Add zero-padding to CSV filenames to include sensors number
2024-08-27 10:11:39 +07:00
Panuluh
8a499a04fb
Merge pull request #17 from nuluh/feature/csv-padding-naming
...
Feature/csv padding naming
2024-08-27 09:23:44 +07:00
Panuluh
118c56c12d
Merge pull request #13 from nuluh/feature/10-add-labels-column-to-time-domain-feature-extraction-dataframe
...
feat(notebook): add 'labels' column to feature extraction dataframe
2024-08-26 09:55:46 +07:00
nuluh
79a0f82372
feat(notebook): add 'labels' column to feature extraction dataframe
...
Implement extraction of 'labels' from directory names and append as a new column in the dataframe during feature extraction. Adapted from the existing `build_features.py` script to enhance data usability in supervised learning models within the Jupyter notebook environment.
Closes #10
2024-08-20 15:28:19 +07:00
Panuluh
c9415c21fa
Merge pull request #9 from nuluh/feature/automate-csv-file
...
Closes #4
2024-08-20 13:01:42 +07:00
nuluh
de902b2a8c
feat: Add launch.json for Python debugger configuration
...
This commit adds a new file, `.vscode/launch.json`, which contains the configuration for launching the Python debugger. The configuration includes the necessary attributes such as the debugger type, request type, program file, console type, and command-line arguments. This configuration allows developers to easily debug Python files in the integrated terminal.
2024-08-20 12:52:48 +07:00
nuluh
57c0e03a4f
docs(script): Update time-domain feature extraction to skip header row separator char info
2024-08-20 12:52:48 +07:00
nuluh
8ab934fe1c
feat(features): refactor feature extraction to handle multiple files and directories
...
- Modify `build_features` function to support iterative processing across nested directories, enhancing the system's ability to handle larger datasets and varied input structures.
- Replace direct usage of `FeatureExtractor` class with `ExtractTimeFeatures` function, which now acts as a wrapper to include this class, facilitating streamlined integration and maintenance of feature extraction processes.
- Implement `extract_numbers` function using regex to parse filenames and extract numeric identifiers, used for labels when training with SVM
- Switch output from `.npz` to `.csv` format in `build_features`, offering better compatibility with data analysis tools and readability.
- Update documentation and comments within the code to reflect changes in functionality and usage of the new feature extraction setup.
Closes #4
2024-08-20 12:52:06 +07:00
nuluh
55db5709a9
refactor(script): Add time-domain feature extraction functionality called ExtractTimeFeatures function returning features in {dictionary} that later called in build_features.py. This function will be called for each individual .csv. Each returning value later appended in build_features.py.
...
This function approach rather than just assigning class ensure the flexibility and enhance maintainability.
2024-08-19 13:20:14 +07:00
nuluh
3860f2cc5b
fix(docs): The readme.md should belong to raw data since the script is intended to simulate raw data that coming from accelerometer sensors instead of processed data that should be generated by simulating frequency domain data instead.
2024-08-18 10:34:22 +07:00
nuluh
553140fe3c
feat(script): add zero-padding to CSV filenames and change the output generated csv as raw data in raw folder
2024-08-17 19:51:42 +07:00
nuluh
1c23edf098
feat: Add .pyc files to .gitignore
2024-08-17 11:41:18 +07:00
