Michael Nebel
5194108233
Java/C#: Improve the newlines in the generated model files.
2022-12-02 12:20:17 +01:00
Michael Nebel
b2dd29ff05
Java/C#: Update conversion script to also produce negative models.
2022-12-02 12:18:50 +01:00
Michael Nebel
d2c458c066
Java/C#: Correction of autogenerated comment(s) produced by the model generator.
2022-11-29 13:05:18 +01:00
Michael Nebel
9f783b018d
Java: Type based summaries are now also for Java.
2022-11-10 13:57:43 +01:00
Michael Nebel
d3a458ef1a
C#: Remove blank lines in generated converted models.
2022-11-08 16:46:38 +01:00
Michael Nebel
8fa6140a0d
C#: Add data extensions version of the model generator scripts.
2022-11-04 08:20:52 +01:00
Michael Nebel
e6a8019c2b
C#: Add python script for generating YAML files containing data extensions.
2022-11-04 08:19:05 +01:00
Michael Nebel
b05a1f4f39
C#: Support for type based model generation via python script.
2022-09-14 11:16:22 +02:00
Tamas Vajk
8c5d220dc0
Add optional friendly name parameter to MaD generator
2022-09-02 16:12:22 +02:00
Michael Nebel
0578d3e6c4
C#: Improve python script to allow generation of Negative summary models.
2022-08-24 09:46:54 +02:00
Jeroen Ketema
05f09919b0
Merge pull request #9276 from jketema/upgrade-script-script
...
Support Go and Swift in the `prepare-db-upgrade` script
2022-05-24 10:09:31 +02:00
Jeroen Ketema
34df9dc835
Support Go and Swift in the `prepare-db-upgrade` script
2022-05-23 19:09:00 +02:00
Chuan-kai Lin
7f96319b37
Clean up direct references to codeql-go
...
This commit removes special handling of the github/codeql-go repository in the
ql-for-ql-dataset_measure.yml and the query-list.yml workflows.
2022-05-20 10:23:48 -07:00
Michael Nebel
c606121ae7
C#: Move autogenerated comment to file level instead of having it on each class.
2022-04-28 11:27:49 +02:00
Michael Nebel
52b59d0eed
C#: Add auto generated comment to generated models as data files.
2022-04-27 15:40:23 +02:00
Michael Nebel
7eddc1e7ec
Java: Adjust scripts for new location.
2022-03-23 10:35:32 +01:00
Michael Nebel
7fc11be787
Java: Move generate_flow_model file into a shared models-as-data script folder.
2022-03-23 10:35:32 +01:00
Tamás Vajk
87e1641772
Revert "Fix MaD workflows to be more resilient to missing files"
2022-03-22 09:08:56 +01:00
Tamás Vajk
80fb021e32
Merge pull request #8294 from github/tamasvajk/fix/mad-adjustments
...
Fix MaD workflows to be more resilient to missing files
2022-03-22 09:02:37 +01:00
Paolo Tranquilli
ef4d1de9c3
check-qhelp: call super init in IncludeHandler
...
`xml.sax.ContentHandler` has a non-trivial `__init__`. While this is
probably harmless, it does not hurt to fix this.
2022-03-01 16:50:55 +01:00
Tamas Vajk
bd30c63aa1
Fix expected file comparer to handle missing files better in MaD workflows
2022-02-28 20:16:20 +01:00
Paolo Tranquilli
01a37e5165
fix `check-qhelp.py` again
2022-02-24 11:56:47 +01:00
Paolo Tranquilli
4020464c2d
fix `check-qhelp.py`
...
It turns out checking changes on `.inc.qhelp` files is a bit trickier,
as we need to first find which `qhelp` files use them. The previous
iteration of this script was working under the assumption that
`.inc.qhelp` files were only included from the current or a parent
path, but this turns out to be wrong.
This time around, if we are asked to check one or more `.inc.qhelp`
files we build an include map from all `qhelp` files and run the help
generator on the `qhelp` files actually including them.
2022-02-24 11:40:46 +01:00
Paolo Tranquilli
9667315d49
pre-commit: add qhelp check
...
Also the instructions on customizing `pre-commit`'s behaviour have been
updated to use the `--config` option.
2022-02-24 10:55:53 +01:00
Jeroen Ketema
671528b483
Find `qldir` by using the location of `prepare-db-upgrade.sh`
2022-02-16 11:35:15 +01:00
Jeroen Ketema
8ad0d8ea69
Factor out creating `upgrade.properties` into a function
2022-02-16 10:54:12 +01:00
Jeroen Ketema
b27dd6ca72
Simplify check_hash_valid
2022-02-16 10:53:39 +01:00
Jeroen Ketema
f558ac5b07
Make `--lang` a required script argument
2022-02-16 10:18:55 +01:00
Jeroen Ketema
1209bbd9b4
Add version of `prepare-db-upgrade.sh` supporting multiple languages
2022-02-15 18:39:21 +01:00
Arthur Baars
dcf71c4f9a
Ruby: update generate-code-scanning-query-list.py
2021-10-25 15:04:34 +02:00
Arthur Baars
a6ac2e73a1
Speed up generate-code-scanning-query-list.py
...
Use 'codeql execute cli-server' to avoid repeated JVM startup overhead
2021-10-25 15:03:28 +02:00
Tamas Vajk
70ffbae091
Introduce foldable region in CSV coverage PR comments
2021-10-19 13:34:25 +02:00
Tamás Vajk
d52616b687
Merge pull request #6683 from tamasvajk/feature/csv-coverage-fix
...
Only leave CSV coverage updater job enabled on github/codeql
2021-09-14 10:13:28 +02:00
Tamas Vajk
80f5ec29d4
Log stdout and stderr in CSV coverage jobs
2021-09-13 16:16:03 +02:00
Tamas Vajk
cc7471f37d
Fix package separator in timeseries report
2021-09-09 12:53:59 +02:00
Tamas Vajk
cbb37f70c4
Change timeseries CSV report to only include dates when values changed
2021-09-09 11:34:38 +02:00
Tamas Vajk
1fe9e9262f
Fix CSV timeseries script to create DB with scheme from correct git SHA
2021-09-09 10:59:52 +02:00
Rasmus Wriedt Larsen
67df890f68
Misc: Fail by default if query pack can't be found
2021-09-03 10:56:49 +02:00
Rasmus Wriedt Larsen
9386a900eb
Misc: Clean whitespace in generate-code-scanning-query-list.py
2021-09-03 10:46:25 +02:00
Tamas Vajk
f3f069fed5
Fix markdown link in framework coverage PR comment
2021-07-02 11:56:00 +02:00
Tamas Vajk
dc63f23d6b
Fix review findings
2021-06-30 13:40:36 +02:00
Tamas Vajk
6a35c8c5f4
Upgrade database in coverage report jobs
2021-06-30 13:40:36 +02:00
Tamás Vajk
10a6089739
Merge pull request #6148 from tamasvajk/feature/try-csv-source-models
...
C#: Start using CSV based flow models
2021-06-30 12:58:42 +02:00
Tamas Vajk
513482b4d5
Adjust code review findings (string escaping)
2021-06-29 08:45:13 +02:00
Tamas Vajk
006303420b
Fix CSV framework coverage commenter workflow
2021-06-28 15:07:13 +02:00
Tamas Vajk
3170781d57
Rework timeseries report to iterate git history only once
2021-06-28 11:29:45 +02:00
Tamas Vajk
1ec1e1cfc8
Adjust framework coverage report generator to include all sources not just remote ones
2021-06-28 11:20:32 +02:00
Tamas Vajk
4524563923
Fix timeseries coverage report to handle multiple languages
2021-06-28 11:20:32 +02:00
Tamas Vajk
1d8b19e153
Adjust coverage report generator to allow multiple sink identifiers per CWE
2021-06-28 11:20:32 +02:00
Tamas Vajk
5aba7142e8
C#: Add framework coverage report
2021-06-28 11:20:32 +02:00
Tamas Vajk
016e8fb2cf
Adjust framework coverage jobs to cover C#
2021-06-28 11:20:32 +02:00
Tamás Vajk
1cddcdfcb1
Merge pull request #6123 from tamasvajk/feature/framework-coverage-pr
...
Add scheduled job to update framework coverage
2021-06-25 09:18:10 +02:00
Tamas Vajk
477dfa28ec
Fix framework coverage commenting action
...
This commit handles the case when the current run finds no coverage change and the previous run is identified,
but it doesn't have the required artifacts.
2021-06-24 10:44:36 +02:00
Tamas Vajk
ad6e47be39
Apply code review findings
2021-06-24 09:13:08 +02:00
Tamas Vajk
7557b7a67d
Add scheduled coverage job to open PR with changes
2021-06-24 09:13:08 +02:00
Tamas Vajk
9d004ec2d5
Handle case when changes had been reported, and then removed
2021-06-23 08:25:20 +02:00
Tamas Vajk
a165cde808
Compute framework coverage diff in artifacts job
2021-06-23 08:25:20 +02:00
Tamas Vajk
d6361d8500
Use string interpolation
2021-06-23 08:23:44 +02:00
Tamas Vajk
12e4ad2640
Fix code quality issues
2021-06-23 08:23:44 +02:00
Tamas Vajk
d28fd363f9
Fix string vs int ID comparison
2021-06-23 08:23:44 +02:00
Tamas Vajk
801007357f
Only post comment with framework coverage change if it changed or wasn't done before
2021-06-23 08:23:44 +02:00
Tamas Vajk
0e91269a23
Refactor framework coverage job to download artifacts from python
2021-06-23 08:23:44 +02:00
Tamas Vajk
07b83d5dc1
Remove commented code
2021-06-17 13:04:39 +02:00
Tamas Vajk
4abaa7870f
Add CSV coverage PR commenter
2021-06-17 13:04:39 +02:00
Tamas Vajk
916780a452
Fix codeql CLI path
2021-06-10 15:07:54 +02:00
Tamas Vajk
b067309909
Change artifact names
2021-06-10 11:26:07 +02:00
Tamas Vajk
55dd6ed3d1
Allow space separated package patterns in framework-aggregated reports
2021-06-10 10:54:12 +02:00
Tamas Vajk
ba9c2e0702
Rework CSV report generator and change timeseries report to use framework.csv
2021-06-10 10:11:24 +02:00
Tamas Vajk
c6cb7c6eed
Rename time-series file to timeseries
2021-06-10 10:11:24 +02:00
Tamas Vajk
d0ec1e2f37
Generate file with package info
2021-06-10 10:11:24 +02:00
Tamas Vajk
3353c3ecdd
Add workflow to generate timeseries CSV coverage report
2021-06-10 10:11:24 +02:00
Tamas Vajk
4de4277a8d
Add timeseries CSV generator script
2021-06-10 10:11:23 +02:00
Tamas Vajk
18931e39c8
Improve error reporting in CI check for CSV coverage report comparison
2021-05-31 09:52:14 +02:00
Tamas Vajk
8880d0055e
Fix file formatting
2021-05-25 13:33:26 +02:00
Tamas Vajk
511486d045
Rework file diff (show line differences)
2021-05-25 13:33:26 +02:00
Tamas Vajk
ce53586002
Refactor file comparison
2021-05-25 13:33:26 +02:00
Tamas Vajk
3db22ba482
Add Java coverage report files
2021-05-25 13:33:26 +02:00
Tamas Vajk
f09352620f
Add comparison step to workflow
2021-05-25 13:33:26 +02:00
Tamas Vajk
f1911e338d
Move and generate files to documentation folder + clean up after the script is executed
2021-05-25 13:33:26 +02:00
Tamas Vajk
6dc46ec1ee
Add org.apache.commons.io to frameworks, and handle overlapping package prefixes
2021-05-25 13:33:25 +02:00
Tamas Vajk
663e6a8d73
Use non-breaking hyphen in CWE identifier
2021-05-25 13:33:25 +02:00
Tamas Vajk
dda401f62a
Inline CSV table into RST page
2021-05-25 13:33:25 +02:00
Tamas Vajk
2e67a3216c
Add option to manually trigger the workflow
2021-05-25 13:33:25 +02:00
Tamas Vajk
1297d1c744
Add framework and cwe static data
2021-05-25 13:33:25 +02:00
Tamas Vajk
2adb3e992a
Code quality improvements on coverage report generator script
2021-05-25 13:33:25 +02:00
Tamas Vajk
d0a46eb7b7
Adjust formatting
2021-05-25 13:33:25 +02:00
Tamas Vajk
f26dba67ac
Adjust 'Total' label to 'Totals'
2021-05-25 13:33:25 +02:00
Tamas Vajk
564fca0da4
Adjust workflow triggers and uploads
2021-05-25 13:33:25 +02:00
Tamas Vajk
ef414681be
Add RST documentation page
2021-05-25 13:33:25 +02:00
Tamas Vajk
beea36191b
Add CSV file with framework and CWE info to be used in RST file
2021-05-25 13:33:25 +02:00
Tamas Vajk
979034a17f
Add github action to generate CSV coverage report
2021-05-25 13:33:25 +02:00
Mathias Vorreiter Pedersen
229ab7623e
- Add pre-commit hook script to misc/scripts
...
- Refer to it in CONTRIBUTING.md
- Add setup note in docs folder
2021-01-05 13:47:30 +01:00
Bas van Schaik
31495b876e
Python script to generate lists of code scanning queries in CSV format ( #4177 )
...
* Create a PowerShell script that can be used to report on the set of queries inside of a particular QL Suite.
* Translate PowerShell script into Python
* support running this script from anywhere within the CodeQL git repo
* print non-fatal error if metadata is not available
* make sure warning about missing pack is printed to stderr
* only run on pushes against main and rcs
* detect repo by checking remote, rather than first SHA
* specify full sha of dsaltares/fetch-gh-release-asset
* trigger workflow on PR that modifies paths of interest
Co-authored-by: Justin Hutchings <jhutchings1@users.noreply.github.com>
Co-authored-by: Aditya Sharad <6874315+adityasharad@users.noreply.github.com>
2020-09-10 12:25:02 -07:00