Граф коммитов

766 Коммитов

Автор SHA1 Сообщение Дата
Harry Maclean 7b81fe3109 Ruby: fix conditional use of cross in build 2023-03-16 12:11:12 +13:00
Harry Maclean e7ead76fe9 Ruby: Build extractor via cargo-cross on linux 2023-03-16 12:04:33 +13:00
Harry Maclean fd43ba0827
Update .github/workflows/ruby-build.yml
Co-authored-by: Arthur Baars <aibaars@github.com>
2023-03-15 09:28:53 +13:00
Harry Maclean eefc4866ea Ruby: build query pack in temporary directory
This ensures we don't clobber any existing directories in the repo.
2023-03-15 08:20:23 +13:00
Harry Maclean 7ee7a0df34 Ruby: fix prefix in create-extractor-pack scripts 2023-03-14 18:12:01 +13:00
Harry Maclean f19e48d473 Ruby: Update binary prefixes in build 2023-03-14 12:53:37 +13:00
Harry Maclean 4de31e8577 Ruby: Ensure right directory for extractor build 2023-03-14 12:40:37 +13:00
Harry Maclean 0e5dcddb98 Ruby: Fix cargo fmt step in build 2023-03-14 12:17:04 +13:00
Harry Maclean 5c59692b3a Ruby: Update workflow for new extractor location 2023-03-14 12:10:56 +13:00
Paolo Tranquilli 162b995428 Swift: turn on QLdoc check 2023-03-02 16:16:12 +01:00
Paolo Tranquilli cdd4e8021b Move `swift/codegen` to `misc/codegen` 2023-02-27 09:46:48 +01:00
erik-krogh 389b7ceff5
support the new shared compilation cache directory 2023-02-20 15:34:03 +01:00
erik-krogh f6fdf45359
remember to actually output the compilation dir 2023-02-20 15:32:50 +01:00
Taus 89aec093c8
Merge pull request #12233 from github/tausbn/add-blame-extractor 2023-02-18 15:06:25 +01:00
erik-krogh cd823d7495
add git info to the checkout 2023-02-18 13:43:24 +01:00
erik-krogh 52a9d5379b
add buramu to the files cached for the extractor 2023-02-18 13:22:41 +01:00
erik-krogh 6f8ae703ca
add the deprecation file when running QL-for-QL 2023-02-18 12:31:14 +01:00
erik-krogh 4f97c0470b
exclude java integration tests from QL-for-QL 2023-02-18 12:21:35 +01:00
Arthur Baars 71c8bb20f9
Merge pull request #12238 from aibaars/query-format-q
CI: make 'codeql query format' less verbose
2023-02-17 15:58:19 +01:00
Arthur Baars 94467e638e CI: make 'codeql query compile' less verbose 2023-02-17 15:20:31 +01:00
Arthur Baars 87cb3fd59f
Update .github/workflows/compile-queries.yml
Co-authored-by: Erik Krogh Kristensen <erik-krogh@github.com>
2023-02-17 14:58:19 +01:00
Arthur Baars c167919ff6 CI: make 'codeql query format' less verbose 2023-02-17 14:53:40 +01:00
erik-krogh 767da59397
remove the paths requirement from running QL-for-QL 2023-02-16 14:57:00 +01:00
erik-krogh 45d00ae9dd
inline the move-caches script into the action 2023-02-16 14:52:46 +01:00
Chris Smowton d075e016b2 Upgrade Go to 1.20 2023-02-14 17:59:18 +00:00
erik-krogh 9364a85e49
add Rust format check to QL-for-QL tests 2023-02-06 14:26:30 +01:00
erik-krogh 34266cfa4c
simplify the QL-for-QL workflow, which should also fix the cache 2023-02-02 22:17:38 +01:00
dependabot[bot] 787fe38d90
build(deps): bump actions/setup-dotnet from 2 to 3.0.2
Bumps [actions/setup-dotnet](https://github.com/actions/setup-dotnet) from 2 to 3.0.2.
- [Release notes](https://github.com/actions/setup-dotnet/releases)
- [Commits](https://github.com/actions/setup-dotnet/compare/v2...v3.0.2)

---
updated-dependencies:
- dependency-name: actions/setup-dotnet
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-02 08:09:43 +00:00
Michael Nebel 3a4e5700e8 C#: Update project targets, workflows and other scripts to use .NET 7. 2023-01-31 13:20:59 +01:00
erik-krogh 94cec17505
bump codeql-action 2023-01-31 12:09:21 +01:00
erik-krogh 4436ec070e
ensure the test is run when the workflow is updated 2023-01-31 12:09:21 +01:00
erik-krogh 40a576b775
fixup the dependabot config for QL-for-QL 2023-01-30 11:22:17 +01:00
Harry Maclean 8050639b16 Ruby: Simplify dependabot config
Dependabot is able to understand cargo workspaces, so it's not necessary
to enumerate each workspace member. It should be enough to configure it
with the workspace root directory. This will hopefully ensure that the
Cargo.lock file gets updated correctly.
2023-01-24 16:37:10 +13:00
Ian Lynagh c2d5281e73
Merge pull request #11930 from igfoo/igfoo/fetch-codeql
CI: fetch-codeql: Set $CODEQL_FETCHED_CODEQL_PATH in the enivironment
2023-01-19 15:33:08 +00:00
Ian Lynagh 3a5bec5778 CI: fetch-codeql: Set $CODEQL_FETCHED_CODEQL_PATH in the enivironment 2023-01-19 11:37:05 +00:00
erik-krogh 9e153cfb0d
change the Ruby-build test such that Windows fails 2023-01-16 15:37:35 +01:00
erik-krogh 2c1ecb507d
fix windows 2023-01-16 15:36:57 +01:00
erik-krogh 1de65131fe
add compilation cache to QL-for-QL tests 2023-01-16 15:36:57 +01:00
erik-krogh 0685732e3f
delete ql/ specific format step now that we have an all-languages format check 2023-01-16 15:36:57 +01:00
erik-krogh 1d62751e15
test QL-for-QL on mac/win 2023-01-16 15:36:55 +01:00
Michael Nebel 600412db48 Java: Ignore missing html artifacts. 2023-01-13 08:58:53 +01:00
Michael Nebel 3b15f2359b
Merge pull request #11861 from michaelnebel/java/testmodeldiff
Java: Update the Model Difference workflow to use the `gh api`.
2023-01-13 08:20:18 +01:00
Arthur Baars af8cb65b2e
Merge pull request #11877 from aibaars/ql-ql-cross
QL/Ruby: include OS version in cache keys for Rust binaries
2023-01-12 20:02:25 +01:00
Michael Nebel fd80974210 Java: Download databases using the gh api instead of lgtm. 2023-01-12 19:30:12 +01:00
Arthur Baars e29e077a03 Ruby/QL4QL: include OS version in cache keys 2023-01-12 15:47:10 +01:00
Michael Nebel 178fd0e9e1 C#/Java: Remove all dashes in mode-generator. 2023-01-11 13:13:33 +01:00
Erik Krogh Kristensen 3fa6a7cbff
cache -> queries
Co-authored-by: Tony Torralba <atorralba@users.noreply.github.com>
2023-01-11 12:29:15 +01:00
erik-krogh 74a58f64aa
move queries folder instead of .cache folder now that we got .qlx 2023-01-11 11:13:42 +01:00
erik-krogh ed2dd87bda
update the codeql-action version used in QL-for-QL 2023-01-11 11:13:06 +01:00
Nick Rolfe 4e6baf83c8
Update .github/workflows/check-change-note.yml
Co-authored-by: Taus <tausbn@github.com>
2023-01-05 16:26:43 +00:00
Nick Rolfe 0beca9d96c CI: fail if a changenote filename doesn't have the right format 2023-01-05 16:01:07 +00:00
Aditya Sharad 9988c19a42
Merge branch 'main' into tutorial/library-pack 2023-01-03 14:08:37 -08:00
Erik Krogh Kristensen 7201071084
Merge pull request #11777 from erik-krogh/use-new-cache
CI: use the new actions/cache@v3 instead of my own fork
2022-12-22 12:15:14 +01:00
erik-krogh b4dddc07f1
use the new actions/cache@v3 instead of my own fork 2022-12-21 21:10:55 +01:00
dependabot[bot] a5bb13f2b6
Bump actions/stale from 6 to 7
Bumps [actions/stale](https://github.com/actions/stale) from 6 to 7.
- [Release notes](https://github.com/actions/stale/releases)
- [Changelog](https://github.com/actions/stale/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/stale/compare/v6...v7)

---
updated-dependencies:
- dependency-name: actions/stale
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-21 03:12:32 +00:00
Aditya Sharad d2ee8c08c0
Ruby: Add shared tutorial pack to testing bundle 2022-12-20 10:56:05 -08:00
erik-krogh a1564de126
more ram 2022-12-12 16:35:01 +01:00
erik-krogh f554e1fef1
more threads 2022-12-12 16:33:07 +01:00
erik-krogh 7526c35c60
speedup the "ATM - Check query suite" CI job 2022-12-12 16:25:25 +01:00
AlexDenisov 2db77a7c08
Merge pull request #11607 from github/redsun82/swift-integration-test-timeout
Swift: add timeout to integration tests on macOS
2022-12-09 08:38:51 +01:00
Henry Mercer 3036b15af2
Merge branch 'main' into henrymercer/check-query-ids 2022-12-08 13:05:46 +00:00
Paolo Tranquilli 0058bf4443 Swift: add timeout to inetgration tests on macOS 2022-12-08 08:44:29 +01:00
Erik Krogh Kristensen be168901d6
Merge pull request #11085 from dbartol/dbartol/ql-for-ql-latest
Use latest released bundle for QL-for-QL
2022-12-06 12:43:53 +01:00
Michael Nebel 204766b967 Java: Adjust generated model paths in Model difference workflow. 2022-12-06 09:53:39 +01:00
Michael Nebel 6fa2193602 Java: Add Model Difference workflow on model generator changes. 2022-12-06 09:26:09 +01:00
Michael Nebel cd5c0bec33
Merge pull request #11527 from michaelnebel/java/regeneratemodels
Java/C#: Delete old model generator scripts and update Java model re-generator script.
2022-12-06 09:24:13 +01:00
Henry Mercer 6484935d25 Add CI job for check query IDs script 2022-12-05 18:51:48 +00:00
Michael Nebel 1c135bd207 Java: Temporarily disable the Model Difference workflow for changes to the model generator. 2022-12-05 11:39:44 +01:00
Michael Nebel 17e7f04adf Java: Update the MaD Model Difference workflow. 2022-12-05 11:39:44 +01:00
Michael Nebel bf332fa5e7 Java: Update MaD regenerate models worksflow. 2022-12-05 11:39:44 +01:00
Tom Hvitved c2d843f96b CI: Change `--ram` value from 52G to 50G in `codeql` tests 2022-12-05 09:35:56 +01:00
Stephan Brandauer e6c5975ed9
Merge pull request #11484 from erik-krogh/js-ml-cache
ATM: use the query compilation cache in the ATM qltest
2022-12-02 10:03:18 +01:00
Paolo Tranquilli e12e86b520 Restore previous cache key
Co-authored-by: Erik Krogh Kristensen <erik-krogh@github.com>
2022-11-30 10:47:29 +01:00
Paolo Tranquilli d165c4963d CI: add workaround for nested composite actions issue
Because of https://github.com/actions/runner/issues/2009 the deeply
nested action cache was failing to save the cache in the post run phase.

For the moment we just avoid the nesting with a copy-pasted action
snippet.
2022-11-30 10:47:29 +01:00
erik-krogh 045e6ef148
remove unused environment variable 2022-11-30 09:59:20 +01:00
erik-krogh 3d0c9c4642
Merge branch 'main' into test-ci 2022-11-30 09:47:08 +01:00
erik-krogh 0eae638a93
combine into one job, and run on an XL runner 2022-11-29 22:34:31 +01:00
erik-krogh 84ce23249f
use the query compilation cache in the ATM qltest 2022-11-29 22:23:23 +01:00
Paolo Tranquilli d7313082c9
Merge pull request #11466 from github/redsun82/cache
Swift: optimize bazel caching in CI
2022-11-29 14:31:16 +01:00
Paolo Tranquilli a3a68fe83d Tweak comment in `incremental-cache` action 2022-11-29 13:09:45 +01:00
Arthur Baars cf7ebe2fa8
Merge pull request #11471 from github/rc/3.8
Merge rc/3.8 into main
2022-11-29 12:57:34 +01:00
erik-krogh 7c1435b7c6
use withFileTypes in move-caches.js some more 2022-11-29 12:16:38 +01:00
Erik Krogh Kristensen 3cb31ef030
use `withFileTypes` in move-caches.js
Co-authored-by: Arthur Baars <aibaars@github.com>
2022-11-29 12:10:00 +01:00
Paolo Tranquilli 52a117aaf5 Swift: optimize bazel caching in CI
Previously the cache would become stale. Now the same incremental
cache mechanism in use for the QL cache is adopted (and factored out
in a separate action).

Namely, pushes on main will populate the cache using the commit hash as
key, while PRs will try to use the cache of their merge base, read-only.

To avoid the cache growing out of control, a simple cache eviction is
done on pushes.
2022-11-29 11:43:54 +01:00
erik-krogh 915d680fcc
use a node script instead of bash to move the compilation cache 2022-11-29 10:41:08 +01:00
erik-krogh 67e9841bf3
place the compilation cache in the temp dir 2022-11-29 10:40:54 +01:00
Felicity Chapman c1e6d4c82a Update .github/ISSUE_TEMPLATE/ql---general.md 2022-11-28 15:26:24 +01:00
Felicity Chapman 36a6ccba8b Remove reference in template 2022-11-28 15:25:38 +01:00
erik-krogh d2824413db
skip the only remaining macos job running on main 2022-11-28 14:44:34 +01:00
Erik Krogh Kristensen 7049532227
Merge pull request #11364 from github/redsun82/swift-ci-cache
Swift: cache more aggressively in CI
2022-11-28 14:34:43 +01:00
Arthur Baars a879fd519a
Merge pull request #11295 from github/aibaars-patch-2
"CodeQL False positive" -> "CodeQL false positive"
2022-11-28 13:06:39 +01:00
erik-krogh 2b0ecec0c8
only run other-os on non-ql changes 2022-11-26 10:43:33 +01:00
erik-krogh dcfa0b38c1
use a non-xl mac runner because the XL runners keep queing 2022-11-26 10:43:33 +01:00
erik-krogh 2b996f11cc
use query compilation cache 2022-11-26 10:43:33 +01:00
erik-krogh 1e732ad4d7
use XL workers, and update the windows runner 2022-11-26 10:43:33 +01:00
erik-krogh b6034b4935
delete language specific format check 2022-11-26 10:43:30 +01:00
Paolo Tranquilli 8df7d465cb Swift: cache more aggressively in CI
* the QL compilation cache action is used for ql and integration tests
* all caches (Bazel and QL) are populated on push
2022-11-25 08:52:46 +01:00
erik-krogh c9a600d496
Ruby: cache the compiled extractor, because that's way smaller than the cargo cache 2022-11-24 10:55:38 +01:00
Tom Hvitved 8f3731fd42 C#: Split `AutobuildOptions` into C#/C++ specific classes 2022-11-23 12:57:16 +01:00
Tom Hvitved 4ad7d2d822 C#: Also include extractor unit tests in `csharp-qltest.yml` 2022-11-22 19:55:38 +01:00
Erik Krogh Kristensen 158ea26dd1
Merge pull request #11362 from erik-krogh/read-only-cache
CI: use read-only-cache when running on a PR
2022-11-22 13:04:34 +01:00
Tom Hvitved ed841aee30
Merge pull request #11329 from hvitved/csharp/qltest-ci
C#: Add workflow for running QL tests
2022-11-22 11:36:16 +01:00
erik-krogh 10c602d9fb
CI: use read-only-cache when running on a PR 2022-11-22 10:20:09 +01:00
Tom Hvitved 313767539a C#: Add workflow for running QL tests 2022-11-22 09:32:44 +01:00
erik-krogh 29055f7709
delete packs 2022-11-22 00:12:33 +01:00
erik-krogh 76ceb49841
re-introduce the paths requirements in the ruby workflows 2022-11-21 17:55:57 +01:00
Erik Krogh Kristensen 53ba22ab5c
simplify pack creation
Co-authored-by: Arthur Baars <aibaars@github.com>
2022-11-21 17:55:57 +01:00
erik-krogh 3b7ce0680d
Ruby: build queries on an XL worker, and use all the threads 2022-11-21 17:55:57 +01:00
erik-krogh 999e8ed0d0
Ruby: remove the path on branch pushes, for caching 2022-11-21 17:55:57 +01:00
erik-krogh b1db390200
Ruby: use compilation cache in the ruby-build workflow 2022-11-21 17:55:57 +01:00
Erik Krogh Kristensen 4f08000a2e
Merge pull request #11344 from erik-krogh/all-the-cache
Ruby: Use compilation cache for the qltest CI workflow
2022-11-21 16:26:29 +01:00
Erik Krogh Kristensen b4661f4a59
Merge pull request #11245 from erik-krogh/rb-redosMod
Ruby: use the shared regex pack
2022-11-21 15:34:20 +01:00
erik-krogh 57a7f89485
change merge-base to merge_base 2022-11-21 15:15:12 +01:00
erik-krogh f50778ae26
Ruby: set ram usage to 52GB in the qltest workflow 2022-11-21 15:02:14 +01:00
erik-krogh a9c95a3230
ruby: delete the path requirement when running qltest on branches 2022-11-21 14:39:56 +01:00
erik-krogh 4af8d5769a
use compilation cache in ruby qltest 2022-11-21 14:35:12 +01:00
erik-krogh 24a973e545
run ruby qltest on a single XL worker 2022-11-21 14:35:12 +01:00
erik-krogh af58329931
split saving the compilation cache into a shared workflow 2022-11-21 14:35:10 +01:00
Tom Hvitved f7fc61e39d
Merge pull request #11336 from hvitved/ruby/ci-check-undefined-labels
Ruby: Add `--check-undefined-labels` to QL test job
2022-11-21 13:36:52 +01:00
AlexDenisov 6f52fe81d1
Merge pull request #11331 from github/redsun82/swift-codegen-skip-unchanged
Swift: skip QL code generation on untouched files
2022-11-21 13:34:41 +01:00
Tom Hvitved 1dbcf8eb10 Ruby: Add `--check-undefined-labels` to QL test job 2022-11-20 10:16:35 +01:00
erik-krogh 41e8170d59
delete the rest of the qlcompile job in Ruby 2022-11-19 11:16:24 +01:00
Paolo Tranquilli 2cd58817d7 Swift: skip QL code generation on untouched files
This is a developer QoL improvement, where running codegen will skip
writing (and especially formatting) any files that were not changed.

**Why?** While code generation in itself was pretty much instant, QL
formatting of generated code was starting to take a long time. This made
unconditionally running codegen quite annoying, for example before each
test run as part of an IDE workflow or as part of the pre-commit hook.

**How?** This was not completely straightforward as we could not work
with the contents of the file prior to code generation as that was
already post-processed by the QL formatting, so we had no chance of
comparing the output of template rendering with that. We therefore store
the hashes of the files _prior_ to QL formatting in a checked-in file
(`swift/ql/.generated.list`). We can therefore load those hashes at
the beginning of code generation, use them to compare the template
rendering output and update them in this special registry file.

**What else?** We also extend this mechanism to detect accidental
modification of generated files in a more robust way. Before this patch,
we were doing it with a rough regexp based heuristic. Now, we just store
the hashes of the files _after_ QL formatting in the same checked file,
so we can check that and stop generation if a generated file was
modified, or a stub was modified without removing the `// generated`
header.
2022-11-18 16:56:01 +01:00
erik-krogh 3cdfed9483
CI: delete language specific codeql query compile checks 2022-11-18 14:41:29 +01:00
erik-krogh 7c091fa6cd
also compile the examples folders as part of the compilation check 2022-11-18 10:31:42 +01:00
Erik Krogh Kristensen 45d4318e0e
Merge pull request #11272 from erik-krogh/clean-cache
CI: clean up the cache when compiling on main
2022-11-17 10:37:08 +01:00
erik-krogh e4b0d8dbf3
simplify the copy-logic, because cp -r actually creates the folders 2022-11-16 16:10:41 +01:00
Arthur Baars 6fb014b34d
"CodeQL False positive" -> "CodeQL false positive" 2022-11-16 13:09:47 +01:00
Arthur Baars bfb0ca7968
Merge pull request #11276 from aibaars/false-positive
CodeQL: add 'False positive' issue template
2022-11-16 13:00:14 +01:00
Arthur Baars f0c3d039a1
Merge pull request #11227 from github/sj/remove-LGTM-issue-template
Remove issue template for LGTM.com false positive reports
2022-11-16 12:59:59 +01:00
Paolo Tranquilli d4f3e38062 Swift: fix path of generated C++ files artifact 2022-11-16 09:49:57 +01:00
Arthur Baars 0ce4500b48
Apply suggestions from code review
Co-authored-by: Pierre <turbo@github.com>
2022-11-15 18:20:28 +01:00
Arthur Baars da7788dd64 CodeQL: add 'False positive' issue template 2022-11-15 16:53:53 +01:00
erik-krogh 65c1e239eb
clean up the cache when compiling on main 2022-11-15 14:49:06 +01:00
erik-krogh 10fff4e2ef
Merge branch 'main' into rb-redosMod 2022-11-14 21:31:10 +01:00
Alex Denisov b5400f6dc9 Swift: remove rebase artifact 2022-11-14 08:55:44 +01:00
Alex Denisov d49015a7e6 Swift: infrastructure for upgrade/downgrade scripts 2022-11-11 15:51:23 +01:00
Bas van Schaik 8147d2048e
Remove issue template for LGTM.com false positive reports 2022-11-11 10:36:26 +00:00
erik-krogh 03a479fd60
use `find` in the format check to fix it 2022-11-11 10:50:42 +01:00
erik-krogh 866e92558c
broaden the file pattern used in the format check to ensure js-ml is included 2022-11-10 17:57:45 +01:00
erik-krogh fbb2dcf7a8
remove langauge specific format checks 2022-11-10 17:47:14 +01:00
erik-krogh a2ce764c82
update codeql-action version used in QL-for-QL, as the old version still used the deprecated set-output feature 2022-11-10 13:58:07 +01:00
erik-krogh ac32f27fdc
don't use the deprecated set-output feature in github-actions 2022-11-10 13:49:29 +01:00
erik-krogh 5ba694e909
remember to run on PRs 2022-11-09 14:55:08 +01:00
erik-krogh 57ad491356
adjust the triggers, run on all PRs, and more branches 2022-11-09 14:50:53 +01:00
erik-krogh 8d51aaa403
add another fallback to main 2022-11-09 14:44:10 +01:00
erik-krogh 7e522770f6
simplify the cache keys 2022-11-09 14:43:30 +01:00
erik-krogh 1b9653827f
do a quicker merge-base calculation 2022-11-09 14:38:55 +01:00
erik-krogh 53917e506e
add refs/heads/ to make the ref fully-formed 2022-11-09 12:58:31 +01:00
erik-krogh f0b09ee16c
fallback to main 2022-11-09 12:55:21 +01:00