Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PVL Core Rebase #5716

Closed
wants to merge 101 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
101 commits
Select commit Hold shift + click to select a range
636eb25
ISIS Application Docs style overhaul (#5617)
jrcain-usgs Oct 1, 2024
0dff523
Noseam has been refactored to be callable. Makefile test has been con…
kledmundson Oct 4, 2024
e64f156
Refactor of the pixel2map application and add geospatial vector file …
afrigeri Oct 4, 2024
f829674
8.3.0 release changes to dev (#5624)
chkim-usgs Oct 7, 2024
6e57958
Update downloadIsisData (#5627)
Kelvinrr Oct 8, 2024
aa6a1d1
Docs pruning (#5628)
jrcain-usgs Oct 8, 2024
275ae63
Update downloadIsisData (#5638)
Kelvinrr Oct 15, 2024
7ca57fa
Bug fixed in isisminer to properly handle self-intersecting polygon g…
kledmundson Oct 17, 2024
e9e973a
Bug fixes to address incorrect handling of RADIUS in the jigsaw GUI a…
kledmundson Oct 25, 2024
cf800a4
Update glossery links to point to the new docs site (#5649)
acpaquette Oct 29, 2024
549a904
Adds Chandrayaan2 to isisimport (#5648)
amystamile-usgs Oct 29, 2024
9b4978e
Speeds up FunctionalTestCamstatsDefaultParameters (#5647)
amystamile-usgs Oct 30, 2024
fee86a1
XmlToJson Namespace fix (#5652)
acpaquette Oct 31, 2024
cda23d6
Adds archive information to chandrayaan2 template (#5651)
amystamile-usgs Oct 31, 2024
ea8743c
flipped sample and line (#5653)
amystamile-usgs Nov 1, 2024
2ead6f7
Updates Pattern Matching Links (#5656)
amystamile-usgs Nov 4, 2024
437e334
findFeaturesSegment.py script fixes (#5565)
chkim-usgs Nov 4, 2024
de5e308
Removed a debug output statement inadvertently left in noseam.cpp. Ad…
kledmundson Nov 7, 2024
1764f59
fixes photomet not accepting backplanes (#5658)
amystamile-usgs Nov 12, 2024
a2cccf1
Convert dstripe to gtests (#5665)
amystamile-usgs Nov 13, 2024
14c8162
addLogGroup Depricated (#5511)
acpaquette Nov 14, 2024
dd0bf99
Testing Valueless PVL Keyword Issues (#5573)
acpaquette Nov 15, 2024
32120b8
Update camstats PvlGroup "User Parameters" to UserParameters (#5672)
AustinSanders Nov 18, 2024
3ea091f
Adds HRSC support in socetlinescankeywords (#5669)
amystamile-usgs Nov 18, 2024
c9a429c
Build Warnings Cleanup (#5671)
amystamile-usgs Nov 19, 2024
d8fb22f
Add majority replacement option for Reduce (#5670)
AustinSanders Nov 19, 2024
038cc5f
added release gitgub action (#5676)
Kelvinrr Nov 21, 2024
3793da6
Fix autoseed SeedDomain = SampleLine (#5674)
AustinSanders Nov 22, 2024
b224a0f
EIS Import Fixes (#5630)
acpaquette Nov 22, 2024
2ed0d48
made the banner smaller (#5666)
Kelvinrr Nov 22, 2024
93104c0
disabled broken tests (#5678)
Kelvinrr Nov 25, 2024
5c0b388
Release trigger fixes (#5681)
Kelvinrr Nov 25, 2024
a8bb044
Adds CI trigger to deploy RC branches (#5682)
Kelvinrr Nov 25, 2024
66ddb75
9.0.0 version bump and release prep (#5683)
Kelvinrr Nov 25, 2024
a8dca4f
Update code.json to revert updating 8.3.0 (#5685)
Kelvinrr Nov 26, 2024
ac1a509
Updated environment truth to reflect the update to ISIS 9 (#5690)
acpaquette Dec 12, 2024
5f857a1
Update Cube Tests (#5689)
acpaquette Dec 13, 2024
c0fded3
kaguyatc2isis invalid BandBin values (#5692)
amystamile-usgs Dec 20, 2024
8d57164
Move from 9.0 to unreleased (#5694)
amystamile-usgs Dec 20, 2024
09cba88
Readme installation (#5679)
jrcain-usgs Dec 20, 2024
e46b6e2
Updates SpiceClient to handle redirect requests (#5696)
amystamile-usgs Jan 3, 2025
3f210e2
Update CHANGELOG.md and environment.yml (#5699)
chkim-usgs Jan 3, 2025
e7457b2
Move banner jpg out of repo to S3, not in public domain (#5680)
jrcain-usgs Jan 3, 2025
7323599
Csv2Table Column Type Update (#5631)
acpaquette Jan 7, 2025
d2486e7
Jigsaw Fixes (#5703)
chkim-usgs Jan 13, 2025
0676eb6
Add serial number translation file for ideal camera (#5695)
AustinSanders Jan 16, 2025
992df27
Fixed Cube::fromIsd to add "LineScanTimes" table from HRSC isds (#5705)
amystamile-usgs Jan 17, 2025
31384b8
Fixed bug where Lat/Lon/Radius point corrections are wrong in points.…
kledmundson Jan 17, 2025
3aa6d78
Revert "Add serial number translation file for ideal camera (#5695)" …
chkim-usgs Jan 17, 2025
8e8ef4d
Update LTS Pipeline (#5714)
chkim-usgs Jan 24, 2025
4d0e290
Added history comment.
AustinSanders Nov 6, 2019
43642ba
Initial move to core
Oct 16, 2020
111e347
Removed Pvl cmakelists
Oct 16, 2020
701ef6b
Removed more cmakelists.txt
Oct 16, 2020
d4664e2
Add subdirectory
Oct 16, 2020
17c839b
Fully modularized core
AustinSanders Oct 22, 2020
7aab8de
Fully modularized core
AustinSanders Oct 22, 2020
6b37a28
replaced PvlEditDialog that was accidentally removed in prev commit
AustinSanders Oct 22, 2020
bf5d0b1
Initial constants unit gtest
AustinSanders Oct 23, 2020
f27b0ed
Fixed pvl core test config (#4349)
jessemapel Mar 10, 2021
40cdf0e
Fixed pvl core test config
jessemapel Mar 9, 2021
52fe3b3
Changed cmake_source to project_source for submodule
jessemapel Mar 9, 2021
5048cf7
First working swig wrappers
AustinSanders Mar 10, 2021
14fa9fc
Rebased off of pvl_core
AustinSanders Mar 10, 2021
e051936
Moved old ISIS unitTests into core (#4351)
jessemapel Mar 11, 2021
fce72a7
Finished swig wrapper with some syntax sugar for ease of use in pytho…
acpaquette Mar 12, 2021
8c09fb9
Initial core deployment (#4355)
AustinSanders Mar 12, 2021
7993d66
Updated preference files (#4354)
jessemapel Mar 12, 2021
816688b
Reset main build and created core recipe
acpaquette Jun 9, 2021
aeca549
Changed pvl recipe url to point to usgsastro
acpaquette Jun 9, 2021
ad1955f
Fixed typo
acpaquette Jun 9, 2021
f6a9f26
Removed a chunk of files that made it through the rebase (#4523)
acpaquette Jun 10, 2021
d296c34
Add Blob to core from base (#4525)
scsides Jun 14, 2021
6ede7f3
Pvl core Docs (#4536)
acpaquette Jun 17, 2021
ee21e4b
Blob Swig Wrapper (#4613)
acpaquette Sep 6, 2021
c45cb95
Post rebase fixes
acpaquette Jul 7, 2023
8028186
Fixed app logging for all call able apps
acpaquette Jul 17, 2023
7e7d335
Moved table reading/writing into core
acpaquette Jul 17, 2023
7aecebc
Fixed missing license identifiers, and leftover merge conflict from r…
acpaquette Jul 20, 2023
60e051c
Removed unnecessary includes to classes outside of core
acpaquette Jul 20, 2023
307df65
Removed tempFixtures include in core tests
acpaquette Jul 20, 2023
de61192
Updates sources and includes for building
acpaquette Jul 20, 2023
05b0d06
Moves necessary fixtures into core
acpaquette Jul 20, 2023
6953049
Enforce that core unit tests use the test preferences
acpaquette Jul 20, 2023
4fed977
Removed commented Application::Name all
acpaquette Jul 20, 2023
7486acb
Initial round of test fixes
acpaquette Jul 21, 2023
1e6463d
Updated IException test truth data
acpaquette Jul 24, 2023
8226ca5
Moved Endian into core
acpaquette Jul 26, 2023
730f186
Remove additional 'm' extension for python 3.10
acpaquette Jul 26, 2023
c1e5823
Set version to 0.0.1 and clamped qt bellow 5.15
acpaquette Jul 26, 2023
d395b74
Initial changes for isis pvl python interface
acpaquette Aug 14, 2023
648233b
Removed prints causing test failures
acpaquette Oct 4, 2023
c56ce7c
Update version to 1.0.0
acpaquette Oct 10, 2023
b819474
Added cxx-compiler as a build dependency
acpaquette Oct 10, 2023
b3826db
Added mesalib as a build and run dependency
acpaquette Oct 10, 2023
55ee77e
Changed all Endian.h to IEndian.h to prevent include shadowing in a c…
acpaquette Oct 11, 2023
c093e2f
Fixed python find for python 3.9
acpaquette Oct 11, 2023
4de40ad
Fix python find for 3.11
acpaquette Oct 11, 2023
a372556
Changed mention of isisio to isiscore
acpaquette Oct 12, 2023
93858dd
Forgot to add name changed file
acpaquette Oct 12, 2023
e510354
Add install command for python bindings
acpaquette Oct 13, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
20 changes: 8 additions & 12 deletions .github/pr_label_checker.py
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ def get_pr_attributes(response: Response) -> tuple:
Get necessary PR attributes.
"""
pull_response_json = response.json()
if len(pull_response_json) == 0:
if not pull_response_json:
# No PRs attributed to the commit
print(False)
sys.exit(0)
Expand All @@ -64,6 +64,7 @@ def search_for_linked_issues(pull_body: str) -> list:
# Split the PR body by heading
pull_body_list = pull_body.split('##')
regex_pattern = rf'{ISSUES_URL}(\d)|(#[^\D]\d*)'
issue_numbers = []
for section in pull_body_list:
# Find section with heading 'Related Issue'
if section != None and 'Related Issue' in section:
Expand All @@ -75,10 +76,7 @@ def search_for_linked_issues(pull_body: str) -> list:
filtered_list = list(filter(None, flattened_list))
# Remove '#' from items
issue_numbers = list(map(lambda item: item.replace('#', ''), filtered_list))
return issue_numbers
# No linked issues
print(False)
sys.exit(0)
return issue_numbers


def get_linked_issues(issue_numbers: list) -> list:
Expand Down Expand Up @@ -113,10 +111,6 @@ def get_issue_labels(response_list: list) -> list:
if label_name not in combined_issue_labels:
# Add label if it does not exist
combined_issue_labels.append(label_name)
if not combined_issue_labels:
# No labels to return
print(False)
sys.exit(0)
return combined_issue_labels

def update_pr_labels(pull_number: str, combined_issue_labels: list):
Expand Down Expand Up @@ -163,9 +157,11 @@ def is_pr_bugfix(response: Response) -> bool:
response = get_prs_associated_with_commit()
pull_number, pull_body = get_pr_attributes(response)
issue_numbers = search_for_linked_issues(pull_body)
response_list = get_linked_issues(issue_numbers)
combined_issue_labels = get_issue_labels(response_list)
update_pr_labels(pull_number, combined_issue_labels)
if issue_numbers:
response_list = get_linked_issues(issue_numbers)
combined_issue_labels = get_issue_labels(response_list)
if combined_issue_labels:
update_pr_labels(pull_number, combined_issue_labels)

# Check if PR is a bugfix
response = get_pr(pull_number)
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
name: Cherrypick bugfixes to release branch
name: Github to Gitlab CI - Run CodeBuild (LTS)

env:
GITLAB_TOKEN: ${{ secrets.GITLAB_TOKEN }}
ANACONDA_TOKEN: ${{ secrets.ANACONDA_TOKEN }}

on:
push:
branches:
Expand Down Expand Up @@ -37,32 +42,30 @@ jobs:
# Print the result to the log
- name: See result
run: echo "${{ steps.execute_py_script.outputs.result }}"
release_pull_request:
build:
needs: check_labels
# Only run this step if the code was a bugfix
if: contains(needs.check_labels.outputs.result, 'true')
runs-on: ubuntu-latest
name: release_pull_request
steps:
- name: checkout
uses: actions/[email protected]
# Fetch all info including branches + tags
with:
fetch-depth: 0
- name: 'Get Previous tag'
id: get_latest_tag
uses: "WyriHaximus/github-action-get-previous-tag@v1"
- id: get_short_version
# Get the major / minor version without patch info i.e. 6.0 from 6.0.1
run: |
major_minor=$(echo ${{steps.get_latest_tag.outputs.tag}} | cut -d '.' -f 1,2)
echo "::set-output name=major_minor::$major_minor"
- name: Create PR to branch
uses: adamtharani/github-action-cherry-pick@master
# PR to the latest feature release. Merges are enabled
with:
pr_branch: ${{steps.get_short_version.outputs.major_minor}}
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
DRY_RUN: false

- uses: actions/checkout@v4
- name: Run script
env:
LTS_VERSION: 9.0.0_LTS # formatted as x.x.x_LTS
BASE_LTS: 9.0
GITHUB_SHA: ${{ secrets.GITHUB_SHA }}
run: |
git config --global user.name "Github_CI"
git config --global user.email "project_14468_bot_3f7d8e1a392afd88ead5f3f3154e809d@noreply.gitlab.com"
git clone https://isis-codebuild-ci:[email protected]/astrogeology/isis-codebuild-ci.git
echo $LTS_VERSION
cd isis-codebuild-ci
if [[ "git ls-remote --exit-code origin $LTS_VERSION" == 2 ]]; then
git checkout -b $LTS_VERSION
else
git checkout $LTS_VERSION
git reset --hard origin/main
fi
echo -e "\nenv: \n shell: bash \n variables: \n LTS_VERSION: $LTS_VERSION \n BASE_LTS: $BASE_LTS \n ANACONDA_API_TOKEN: $ANACONDA_TOKEN \n GITHUB_SHA: $GITHUB_SHA" >> buildspec-lts.yml
git commit -a -m "$LTS_VERSION"
git push origin $LTS_VERSION --force
32 changes: 32 additions & 0 deletions .github/workflows/gitlab-release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: Github to Gitlab CI - Run CodeBuild

env:
GITLAB_TOKEN: ${{ secrets.GITLAB_TOKEN }}
ANACONDA_TOKEN: ${{ secrets.ANACONDA_TOKEN }}

on:
release:
types: [prereleased, released]
push:
branches:
- '*.*.*_RC*'
jobs:
build:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v4
- name: Run script
env:
ISIS_VERSION: ${{ github.event.release.tag_name || github.ref_name }}
run: |
git config --global user.name "Github_CI"
git config --global user.email "project_14468_bot_3f7d8e1a392afd88ead5f3f3154e809d@noreply.gitlab.com"
git clone https://isis-codebuild-ci:[email protected]/astrogeology/isis-codebuild-ci.git
echo $ISIS_VERSION
cd isis-codebuild-ci
git checkout -b RELEASE_$ISIS_VERSION
echo -e "\nenv: \n shell: bash \n variables: \n ISIS_VERSION: $ISIS_VERSION \n ANACONDA_API_TOKEN: $ANACONDA_TOKEN" >> buildspec-release.yml
git commit -a -m "$ISIS_VERSION"
git push origin RELEASE_$ISIS_VERSION --force

3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -7,9 +7,10 @@
# Unignore all dirs
!*/

# Unignore Makefiles, and TestPreferences
# Unignore Makefiles, IsisPreferences, and TestPreferences
!Makefile
!TestPreferences
!IsisPreferences
!*/3rdParty/Makefile

# Unignore version file
Expand Down
18 changes: 0 additions & 18 deletions .readthedocs.yaml

This file was deleted.

5 changes: 5 additions & 0 deletions .zenodo.json
Original file line number Diff line number Diff line change
Expand Up @@ -166,6 +166,11 @@
"affiliation": "United States Geological Survey, Astro Geology Science Center",
"name": "Fergason, Robin"
},
{
"affiliation": "Italian National Institute for Astrophysics (INAF), Istituto di Astrofisica e Planetologia Spaziali (IAPS), Rome, Italy",
"name": "Frigeri, Alessandro",
"orcid": "0000-0002-9140-3977"
},
{
"name": "Gaddis, Lisa"
},
Expand Down
2 changes: 1 addition & 1 deletion AUTHORS.rst
Original file line number Diff line number Diff line change
Expand Up @@ -176,4 +176,4 @@ Integrated Software for Imagers and Spectrometers Contributors

-----
This list was generated from the .zenodo.json file by running the
isis/scripts/zenodo_to_authors.py Python program.
isis/scripts/zenodo_to_authors.py Python program.
44 changes: 42 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,17 +35,58 @@ release.

## [Unreleased]

### Added

### Changed

### Fixed
- Fixed kaguyatc2isis invalid BandBin values [#5629](https://github.com/DOI-USGS/ISIS3/issues/5629)
- Fixed SpiceClient to handle redirect requests.
- Fixed jigsaw to default OUTADJUSTMENTH5 option to false and allow this feature to run on read-only images [#5700](https://github.com/DOI-USGS/ISIS3/issues/5700)
- Fixed Cube::fromIsd to add "LineScanTimes" table from HRSC isds [#5668](https://github.com/DOI-USGS/ISIS3/issues/5668)

## [9.0.0] - 09-25-2024

### Added
- Added TOVECT output parameter which generate a geospatial CSV file with a VRT metadata sidecar file [#5571](https://github.com/DOI-USGS/ISIS3/issues/5571)
- Added Vectorize to ProcessGroundPolygon library
- Added gtest files for the app and unit test
- Added Chandrayaan2 template for isisimport
- Added majority replacement for reduce app [#5101](https://github.com/DOI-USGS/ISIS3/issues/5101).
- Added HRSC support in socetlinescankeywords [#5465](https://github.com/DOI-USGS/ISIS3/issues/5465)
- Added option to save and apply bundle adjustment values in `jigsaw` [#4474](https://github.com/DOI-USGS/ISIS3/issues/4474)
- Added the ability to pass column types in csv2table to set the column types in the resulting ISIS table [#5631](https://github.com/DOI-USGS/ISIS3/pull/5631)

### Changed
- Refactored the pixel2map app
- Updated pixel2map documentation
- Changed PVL parsing to no longer allow valueless keywords [#5573](https://github.com/DOI-USGS/ISIS3/pull/5573)
- Changed all `.trn` files with an `Auto`, `Debug` or `Optional` keyword with no value to have a value of `1` [#5573](https://github.com/DOI-USGS/ISIS3/pull/5573)
- Changed 'User Parameters' group in camstats to UserParameters for PVL compliance [#5625](https://github.com/DOI-USGS/ISIS3/issues/5625).

### Fixed
- Fixed bug in the method BundleSolutionInfo::outputPointsCSV() where, when performing a rectangular (XYZ) bundle adjustment, the Lat/Lon/Radius point corrections written to points.csv are incorrect and do not match those written to bundleout.txt. Also modified the ctest FunctionalTestJigsawBundleXYZ to spot check six lines (points) in points.csv.
Issue: [5646](https://github.com/DOI-USGS/ISIS3/issues/5646)
- Fixed noseam bug where a debugging output statement was inadvertently left in noseam.cpp.
Issue: [5660](https://github.com/DOI-USGS/ISIS3/issues/5660)
- Fixed jigsaw bugs in which RADIUS is handled incorrectly in the jigsaw gui and in the bundleout.txt
file. Slightly modified the FunctionalTestJigsawBundleXYZ ctest accordingly. Issue: [5642](https://github.com/DOI-USGS/ISIS3/issues/5642)
- Fixed a bug in isisminer in which bad (e.g. self-intersecting) polygon geometries were not treated properly. Added pertinent unit tests to GisGeometry and Strategy classes. Issue: [5612](https://github.com/DOI-USGS/ISIS3/issues/5612)
- Fixed a bug in kaguyasp2isis that doesn't work for data with a detached label.
- Fixed FunctionalTestCamstatsDefaultParameters test by increasing the runtime speed [#5459](https://github.com/DOI-USGS/ISIS3/issues/5459)
- Fixed XmlToJson namespaced key conversion [#5652](https://github.com/DOI-USGS/ISIS3/pull/5652)
- Fixed PHOTOMET not accepting backplanes [#5281](https://github.com/DOI-USGS/ISIS3/issues/5281)
- Fixed dstripe parallel test failing by converting tests to gtests [#5613](https://github.com/DOI-USGS/ISIS3/issues/5613)
- Fixed autoseed SeedDomain = SampleLine only working for first overlap [#5673](https://github.com/DOI-USGS/ISIS3/issues/5673)

## [8.3.0] - 2024-08-16
## [8.3.0] - 2024-09-30

### Added
- Added backplane options for SunIllumination and SurfaceObliqueDetectorResolution to phocube [#5467](https://github.com/DOI-USGS/ISIS3/issues/5467)
- Added *.history to the ignore list in downloadIsisData

### Changed
- Noseam has been refactored to be callable; old Makefile test has been removed and replaced by a gtest. Issue: [#5599](https://github.com/USGS-Astrogeology/ISIS3/issues/5599)
- Explode has been refactored to be callable; old Makefile test has been removed and replaced by a gtest. Issue: [#5557](https://github.com/USGS-Astrogeology/ISIS3/issues/5557)
- Isisminer has been refactored to be callable; old Makefile tests have been removed and replaced by gtests. Issue: [#5516](https://github.com/USGS-Astrogeology/ISIS3/issues/5516)
- Algebra has been refactored to be callable; old Makefile tests have been removed and replaced by gtests. Issue: [#5594](https://github.com/USGS-Astrogeology/ISIS3/issues/5594)
Expand All @@ -70,7 +111,6 @@ release.
- Fixed gllssi2isis to support V1.1 data [#5396](https://github.com/DOI-USGS/ISIS3/issues/5396)

### Added
- Added option to save and apply bundle adjustment values in `jigsaw` [#4474](https://github.com/DOI-USGS/ISIS3/issues/4474)
- Added versioned default values to lrowacphomap's PHOALGO and PHOPARCUBE parameters and updated lrowacphomap to handle them properly. [#5452](https://github.com/DOI-USGS/ISIS3/pull/5452)

## [8.2.0] - 2024-04-18
Expand Down
Loading