|
| 1 | +--- |
| 2 | +name: Peer Review |
| 3 | +about: Use to submit a peer review |
| 4 | +title: '' |
| 5 | +labels: review |
| 6 | +assignees: '' |
| 7 | +--- |
| 8 | + |
| 9 | +## Peer Review for Reproducibility Checks |
| 10 | + |
| 11 | +### Review Checklist |
| 12 | + |
| 13 | +Please review the following aspects related to reproducibility checks: |
| 14 | + |
| 15 | +- [ ] **Environment Setup**: |
| 16 | + - [ ] Were detailed instructions provided for setting up the development environment? |
| 17 | + - [ ] Are all necessary dependencies and libraries clearly documented? |
| 18 | +- [ ] **Data Preparation**: |
| 19 | + - [ ] Are source data files and preprocessing steps clearly documented? |
| 20 | + - [ ] Are scripts or commands for data transformation included and well-documented? |
| 21 | +- [ ] **Code Execution**: |
| 22 | + - [ ] Were clear instructions provided for running the code? |
| 23 | + - [ ] Does the code execute without errors and produce expected outputs? |
| 24 | +- [ ] **Configuration Management**: |
| 25 | + - [ ] Is version control information (e.g., Git commit hash) included for reproducibility? |
| 26 | + - [ ] Are any configuration files or parameters used properly documented? |
| 27 | +- [ ] **Results Verification**: |
| 28 | + - [ ] Are output results (e.g., metrics, visualizations) included and matched with expected outcomes? |
| 29 | + - [ ] Have any discrepancies between expected and actual results been identified and explained? |
| 30 | +- [ ] **Documentation**: |
| 31 | + - [ ] Is there a detailed README or documentation explaining the experiment setup and execution process? |
| 32 | + - [ ] Are code comments and documentation clear and informative? |
| 33 | +- [ ] **External Dependencies**: |
| 34 | + - [ ] Are any external data sources or APIs used accessible and well-documented? |
| 35 | + - [ ] Are external libraries or packages properly cited and versioned for reproducibility? |
| 36 | +- [ ] **Validation**: |
| 37 | + - [ ] Can an independent reviewer replicate the experiment using the provided instructions? |
| 38 | + - [ ] Are the results consistent across different environments or platforms? |
| 39 | + |
| 40 | +### Additional Comments |
| 41 | + |
| 42 | +Include any additional comments, concerns, or suggestions related to reproducibility. |
0 commit comments