Code

Feature/SubmissionProfiles (master)#1756

Code

Closed

cccs-rs wants to merge 107 commits intomasterCybercentreCanada/assemblyline-base:masterfrom AL-2646CybercentreCanada/assemblyline-base:AL-2646Copy head branch name to clipboard

+606-108

Commits

Commits on Nov 24, 2023

• Handle partial results

  

  gdesmar

  authored and

  cccs-douglass

  committed
  66978b7

  Copy full SHA for 66978b7

• add monitored keys

  cccs-douglass

  committed
  78054db

  Copy full SHA for 78054db

Commits on Nov 27, 2023

• small additional changes

  cccs-douglass

  committed
  b7004c4

  Copy full SHA for b7004c4

Commits on Dec 8, 2023

• fix use of depricated interface

  cccs-douglass

  committed
  4fd9e2d

  Copy full SHA for 4fd9e2d

• add config for special temporary keys

  cccs-douglass

  committed
  d868dbc

  Copy full SHA for d868dbc

Commits on Jul 10, 2024

• Add a new poweruser role type that can do more than a normal user

  cccs-rs

  committed
  7bcc745

  Copy full SHA for 7bcc745

• Add a submission profile configuration for basic user usage

  cccs-rs

  committed
  d3794da

  Copy full SHA for d3794da

Commits on Jul 30, 2024

• Omit runtime_excluded from ServiceSelection model (unused)

  cccs-rs

  committed
  e49f48b

  Copy full SHA for e49f48b

• Create a SubmissionProfileParams model for submission profiles

  cccs-rs

  committed
  a8a03ea

  Copy full SHA for a8a03ea

• Add params to Static Analysis profile

  cccs-rs

  committed
  6af6eb0

  Copy full SHA for 6af6eb0

Commits on Jul 31, 2024

• Remove unused submission parameter from v3

  cccs-rs

  committed
  2b9755e

  Copy full SHA for 2b9755e

• Add generate_alert and ttl as enforced parameters

  cccs-rs

  committed
  116afd6

  Copy full SHA for 116afd6

Commits on Aug 9, 2024

• Update SubmissionProfileParams model to all be optional fields

  cccs-rs

  committed
  f9808e9

  Copy full SHA for f9808e9

Commits on Oct 11, 2024

• Allow users to change some properties of submission profiles

  cccs-rs

  committed
  25733c7

  Copy full SHA for 25733c7

Commits on Oct 15, 2024

• Merge branch 'master' into AL-2646

  cccs-nr

  committed
  7a8b82a

  Copy full SHA for 7a8b82a

Commits on Oct 22, 2024

• Merge branch 'master' into AL-2646

  cccs-nr

  committed
  29dfce2

  Copy full SHA for 29dfce2

• Added the public key in the APIProxies that contains properties to be passed to the frontend for configuration purposes.

  cccs-nr

  committed
  4e2f261

  Copy full SHA for 4e2f261

Commits on Oct 23, 2024

• Allow for configuring core params

  cccs-rs

  committed
  f1be7a4

  Copy full SHA for f1be7a4

• Prevent binary files from being identified as au3

  cccs-jh

  committed
  3a06d20

  Copy full SHA for 3a06d20

Commits on Oct 24, 2024

• Merge branch 'master' into AL-2646

  cccs-nr

  committed
  783958a

  Copy full SHA for 783958a

Commits on Oct 29, 2024

• Identify csv when first identified not text/plain

  gdesmar

  committed
  067deac

  Copy full SHA for 067deac

• Merge pull request #1824 from CybercentreCanada/identify_unknown_csv

  Show description for 9d34089
  gdesmar

  authored
  9d34089

  Copy full SHA for 9d34089

• Identify python pickle files

  gdesmar

  committed
  5b6725c

  Copy full SHA for 5b6725c

Commits on Oct 30, 2024

• Merge pull request #1827 from CybercentreCanada/identify_pickle

  Show description for 52134cd
  gdesmar

  authored
  52134cd

  Copy full SHA for 52134cd

• Adding text/rdp Identification

  gdesmar

  committed
  168db81

  Copy full SHA for 168db81

• Merge pull request #1829 from CybercentreCanada/identify_rdp

  Show description for 2937ecb
  gdesmar

  authored
  2937ecb

  Copy full SHA for 2937ecb

• Support validation of lists that have been JSON encoded

  cccs-rs

  committed
  86d73fc

  Copy full SHA for 86d73fc

Commits on Oct 31, 2024

• Add floats to metadata validation

  cccs-rs

  committed
  1c274ad

  Copy full SHA for 1c274ad

• Identify html that starts and/or end with an html comment

  gdesmar

  committed
  c75a9ca

  Copy full SHA for c75a9ca

• Merge pull request #1832 from CybercentreCanada/identify_html_with_comment

  Show description for 6e50b51
  gdesmar

  authored
  6e50b51

  Copy full SHA for 6e50b51

Commits on Nov 1, 2024

• Allow suggestions from the system to merge with the list of values for enum types

  cccs-rs

  committed
  02361d3

  Copy full SHA for 02361d3

Commits on Nov 5, 2024

• Merge remote-tracking branch 'origin/master' into partial_results

  cccs-douglass

  committed
  9d25f51

  Copy full SHA for 9d25f51

• Merge pull request #1817 from CybercentreCanada/au3_fix

  Show description for 1fab191
  cccs-jh

  authored
  1fab191

  Copy full SHA for 1fab191

Commits on Nov 8, 2024

• simplify and document temporary key config options

  cccs-douglass

  committed
  dcf3563

  Copy full SHA for dcf3563

Commits on Nov 18, 2024

• Fallback to mimetype when yara identification yielded no conclusive result

  gdesmar

  committed
  568a30c

  Copy full SHA for 568a30c

• Adding lzma executor and diverse python indicators

  gdesmar

  committed
  52cb8f7

  Copy full SHA for 52cb8f7

• Add a flag in the config to move success and failure logs to the audit logs

  sgaron-msft

  committed
  3fa961c

  Copy full SHA for 3fa961c

• Add params to file source to select specific service and to skip the download from url call

  sgaron-msft

  committed
  a896b2a

  Copy full SHA for a896b2a

• Switching from mandatory base64 to one-of base64,zlib,lzma

  gdesmar

  committed
  9b27d79

  Copy full SHA for 9b27d79

Commits on Nov 19, 2024

• Apply suggestions from code review

  Show description for fe82e8c
  

  sgaron-msft

  and

  gdesmar

  authored
  fe82e8c

  Copy full SHA for fe82e8c

• Change select_as_service from a bool to a list of selected services (select_services)

  sgaron-msft

  committed
  52bb66d

  Copy full SHA for 52bb66d

Commits on Nov 21, 2024

• Merge pull request #1837 from CybercentreCanada/untrusted_mimes

  Show description for b0f3d66
  gdesmar

  authored
  b0f3d66

  Copy full SHA for b0f3d66

• Merge pull request #1839 from CybercentreCanada/identify_lzma_executor

  Show description for 462c7a7
  gdesmar

  authored
  462c7a7

  Copy full SHA for 462c7a7

Commits on Nov 22, 2024

• Fix redis connection hangs even if using retries

  sgaron-msft

  committed
  dedde1b

  Copy full SHA for dedde1b

• Add retry call to psubscribe in event watcher

  sgaron-msft

  committed
  e57ff62

  Copy full SHA for e57ff62

• Merge pull request #1840 from sgaron-msft/login_audit

  Show description for f802b6f
  cccs-douglass

  authored
  f802b6f

  Copy full SHA for f802b6f

• Merge pull request #1842 from sgaron-msft/url_to_specific_service

  Show description for de89609
  cccs-douglass

  authored
  de89609

  Copy full SHA for de89609

• Merge pull request #1844 from sgaron-msft/redis_retry_fix

  Show description for b544b20
  cccs-douglass

  authored
  b544b20

  Copy full SHA for b544b20

• More RDP file settings

  gdesmar

  committed
  d1fd0d6

  Copy full SHA for d1fd0d6

Commits on Nov 25, 2024

• Merge pull request #1847 from CybercentreCanada/identify_more_rdp

  Show description for 77c801e
  gdesmar

  authored
  77c801e

  Copy full SHA for 77c801e

Commits on Nov 26, 2024

• typo

  cccs-douglass

  committed
  fc2ca47

  Copy full SHA for fc2ca47

• Update assemblyline/odm/models/config.py

  Show description for f85f815
  

  cccs-douglass

  and

  gdesmar

  authored
  f85f815

  Copy full SHA for f85f815

Commits on Nov 27, 2024

• Add a field to keep the identity ID of a user

  sgaron-msft

  committed
  a490f43

  Copy full SHA for a490f43

• Tell oauth provider which field to use for identity ID

  sgaron-msft

  committed
  1700cf6

  Copy full SHA for 1700cf6

Commits on Dec 4, 2024

• Update priority ranges to be consistent with UI

  cccs-rs

  committed
  b2ad1af

  Copy full SHA for b2ad1af

• Update models to define value ranges with respect to priority constants

  cccs-rs

  committed
  f9a404b

  Copy full SHA for f9a404b

• Update range to use constant for the minimum

  cccs-rs

  committed
  83b2b67

  Copy full SHA for 83b2b67

• Update randomizer to leverage field min/max values

  cccs-rs

  committed
  7f6be62

  Copy full SHA for 7f6be62

• Update constants.py

  cccs-rs

  authored
  f930c69

  Copy full SHA for f930c69

• add defaults to temporary_key config

  cccs-douglass

  committed
  6ff369d

  Copy full SHA for 6ff369d

• Merge branch 'partial_results' of github.com:CybercentreCanada/assemblyline-base into partial_results

  cccs-douglass

  committed
  b591047

  Copy full SHA for b591047

Commits on Dec 6, 2024

• Merge pull request #1830 from CybercentreCanada/metadata_validation

  Show description for 2186f58
  cccs-rs

  authored
  2186f58

  Copy full SHA for 2186f58

• Merge pull request #1851 from CybercentreCanada/bugfixes/priority

  Show description for 464f099
  cccs-rs

  authored
  464f099

  Copy full SHA for 464f099

• Update S3 testing to use minio instead of Amazon

  cccs-rs

  committed
  0b2a298

  Copy full SHA for 0b2a298

• Add new configuration options for UpdateSource model

  cccs-rs

  committed
  9834b98

  Copy full SHA for 9834b98

• Merge pull request #1855 from CybercentreCanada/hotfix/update_s3_tests

  Show description for 49cc8ae
  cccs-rs

  authored
  49cc8ae

  Copy full SHA for 49cc8ae

• Fix model for ServiceDelta

  cccs-rs

  committed
  225fbd2

  Copy full SHA for 225fbd2

Commits on Dec 9, 2024

• Add a configuration to ignore source update caching; remove data configuration for POST requests

  cccs-rs

  committed
  6a98b4f

  Copy full SHA for 6a98b4f

• Merge pull request #1811 from CybercentreCanada/update/borealis

  Show description for 4a93791
  cccs-nr

  authored
  4a93791

  Copy full SHA for 4a93791

Commits on Dec 12, 2024

• Merge pull request #1346 from CybercentreCanada/partial_results

  Show description for f528f87
  cccs-douglass

  authored
  f528f87

  Copy full SHA for f528f87

• Merge pull request #1856 from CybercentreCanada/improvements/update_sources

  Show description for c29f5f7
  cccs-rs

  authored
  c29f5f7

  Copy full SHA for c29f5f7

Commits on Dec 17, 2024

• Formatted the submission profiles models

  cccs-nr

  committed
  3dabed1

  Copy full SHA for 3dabed1

Commits on Dec 18, 2024

• Update README

  cccs-rs

  committed
  61fb1a9

  Copy full SHA for 61fb1a9

• Fix link to licence

  cccs-rs

  committed
  a3f80eb

  Copy full SHA for a3f80eb

Commits on Dec 20, 2024

• Merge pull request #1859 from CybercentreCanada/readme_update

  Show description for a858868
  cccs-rs

  authored
  a858868

  Copy full SHA for a858868

Commits on Jan 8, 2025

• Prevent END IF; as strong indicator for VBS

  Show description for 3a6566d
  cccs-jh

  committed
  3a6566d

  Copy full SHA for 3a6566d

• Add CREATE OR REPLACE as strong sql indicator

  cccs-jh

  committed
  704b453

  Copy full SHA for 704b453

Commits on Jan 9, 2025

• Merge pull request #1861 from CybercentreCanada/bugfix/identify_sql_vbs

  Show description for 6e816cc
  cccs-jh

  authored
  6e816cc

  Copy full SHA for 6e816cc

• Add identification for javascript functions without parameters

  cccs-jh

  committed
  09328a1

  Copy full SHA for 09328a1

• Merge pull request #1862 from CybercentreCanada/identify_javascript_function

  Show description for 926f1a6
  cccs-jh

  authored
  926f1a6

  Copy full SHA for 926f1a6

Commits on Jan 10, 2025

• Prevent methods ending in Execute from being identified as VBS

  cccs-jh

  committed
  1b7b447

  Copy full SHA for 1b7b447

• Merge pull request #1863 from CybercentreCanada/identify_java_vbs

  Show description for 7c345e9
  cccs-jh

  authored
  7c345e9

  Copy full SHA for 7c345e9

Commits on Jan 13, 2025

• Merge pull request #1849 from sgaron-msft/login_mi_token

  Show description for c42edb2
  cccs-rs

  authored
  c42edb2

  Copy full SHA for c42edb2

Commits on Jan 14, 2025

• Remving copy from small batch identification

  gdesmar

  committed
  96cb47e

  Copy full SHA for 96cb47e

• Merge pull request #1864 from CybercentreCanada/remove_copy_small_batch_id

  Show description for 3c2509e
  gdesmar

  authored
  3c2509e

  Copy full SHA for 3c2509e

Commits on Jan 28, 2025

• Improve CSV identification

  gdesmar

  committed
  7e24b8b

  Copy full SHA for 7e24b8b

• Rewind the file if we need to retry csv identification

  gdesmar

  committed
  0d0f31f

  Copy full SHA for 0d0f31f

• Fix typo in comment

  cccs-rs

  authored
  ba1addb

  Copy full SHA for ba1addb

• Update azure-tests.yaml

  cccs-rs

  authored
  2cf8759

  Copy full SHA for 2cf8759

• Merge pull request #1872 from CybercentreCanada/improve_csv_ident

  Show description for be3bd33
  gdesmar

  authored
  be3bd33

  Copy full SHA for be3bd33

• Add addtional fields to SubmissionProfiles

  cccs-rs

  committed
  1bdaf0d

  Copy full SHA for 1bdaf0d

Commits on Feb 1, 2025

• Update models

  cccs-rs

  committed
  1825cc5

  Copy full SHA for 1825cc5

• Add a new poweruser role type that can do more than a normal user

  cccs-rs

  committed
  9815a3b

  Copy full SHA for 9815a3b

• Add a submission profile configuration for basic user usage

  cccs-rs

  committed
  c9a1a5a

  Copy full SHA for c9a1a5a

• Omit runtime_excluded from ServiceSelection model (unused)

  cccs-rs

  committed
  80a2bc3

  Copy full SHA for 80a2bc3

• Create a SubmissionProfileParams model for submission profiles

  cccs-rs

  committed
  5144bcf

  Copy full SHA for 5144bcf

• Add params to Static Analysis profile

  cccs-rs

  committed
  1a49574

  Copy full SHA for 1a49574

• Remove unused submission parameter from v3

  cccs-rs

  committed
  6a7d0c9

  Copy full SHA for 6a7d0c9

• Add generate_alert and ttl as enforced parameters

  cccs-rs

  committed
  088775c

  Copy full SHA for 088775c

• Update SubmissionProfileParams model to all be optional fields

  cccs-rs

  committed
  a91f2f1

  Copy full SHA for a91f2f1

• Allow users to change some properties of submission profiles

  cccs-rs

  committed
  255d4b6

  Copy full SHA for 255d4b6

• Allow for configuring core params

  cccs-rs

  committed
  d700c1c

  Copy full SHA for d700c1c

• Formatted the submission profiles models

  

  cccs-nr

  authored and

  cccs-rs

  committed
  1cd81f0

  Copy full SHA for 1cd81f0

• Add addtional fields to SubmissionProfiles

  cccs-rs

  committed
  1c2fce9

  Copy full SHA for 1c2fce9

• Update models

  cccs-rs

  committed
  a3e9afe

  Copy full SHA for a3e9afe

• Merge remote-tracking branch 'refs/remotes/origin/AL-2646' into AL-2646

  cccs-rs

  committed
  9b2c905

  Copy full SHA for 9b2c905

• Fix merge conflicts

  cccs-rs

  committed
  8053537

  Copy full SHA for 8053537