144920a4d9
Update promptflow-ci to use check-directory-file-changes to allow for required status check ( #3420 )
...
* Update promptflow-ci to use check-directory-file-changes to allow for required status check
* update echo message
* update logging for promptflow_ci.py
* fix syntax issue
* update logging again
* update skipped flows
* update skipped-flows
* remove whitespace
* remove backslash
* update list of flows
* update errors count
---------
Co-authored-by: lykelly19 <kellyly@microsoft.com>
2024-09-30 09:48:30 -07:00
1134373522
Add new UI eval flow ( #3411 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
* address spell error
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
Co-authored-by: vizhur <vizhur@microsoft.com>
2024-09-20 15:36:44 -04:00
ef25f1b2ef
Revert "Add new UI eval flow ( #3403 )" ( #3410 )
...
This reverts commit 87fb836f4c
2024-09-20 15:03:31 -04:00
87fb836f4c
Add new UI eval flow ( #3403 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
2024-09-20 18:57:36 +00:00
e0251f6658
rai-qna-quality-safety-eval flow Version 2 with answer generation functionality ( #3354 )
...
* Update model.yaml
* Update spec.yaml
* Create test_config.json
* Update test_config.json
2024-09-09 11:12:41 -07:00
9d970dd070
Add 2 promptflow models for rerank tool sample flows ( #3237 )
...
* add rerank-qna and multi-index-rerank-qna
* change to Default_AzureOpenAI
* fix dependencies
* install numpy<2
* add rerank to cspell
* add description
* update description
* remove numpy
* numpy version
* change sample input/output
* change input/output
2024-08-09 15:51:58 +08:00
d45f3796fd
Revert "save"
...
This reverts commit f845a5dc277a54b91f3a
2024-07-01 14:10:32 -04:00
f845a5dc27
save
2024-07-01 13:39:37 -04:00
171ab4b205
get portal_url from result instead of construct them ( #2777 )
...
* get portal_url from result instead of construct them
* add .pyc to cspell.json
* refine
* Refine
---------
Co-authored-by: Ge Gao <gega@microsoft.com>
2024-04-28 09:37:22 +08:00
2f23da9ed8
[Promptflow] Add model assets for Azure AI Language Prompt Flow gallery examples. ( #2766 )
...
* add assets for promptflow-azure-ai-language example flows
* remove follow-up tasks from analyze conversations example flow
2024-04-26 09:59:13 +08:00
7c3d70d272
Update Flow Model Version of Playground-ayod-rag Template ( #2765 )
...
* Update description.md
* Update model version in model.yaml
* Update model version spec.yaml
* Update search index info in test_config.json
* Update query in test_data.json
2024-04-24 14:34:39 -04:00
98ddb9a12f
[Internal] Add extra requirements "azure" for promptflow package ( #2699 )
...
* add pf azure pkg in ci
* update
---------
Co-authored-by: yalu4 <yalu4@microsoft.com>
2024-04-18 08:03:47 +08:00
dafa5905e1
Update Playground AYOD RAG Prompt Flow Model Version ( #2501 )
...
* Update description.md
* Update model.yaml
* Update spec.yaml
* Update test_config.json for playground-ayod-rag P1
* Update test_config.json: update P2
* Create test_data.json with test example
* Update .cspell.json: ignore jsonl file types
2024-03-15 10:02:03 +08:00
0d23efe3e7
Update Playground AYOD RAG Prompt Flow Model Version ( #2501 )
...
* Update description.md
* Update model.yaml
* Update spec.yaml
* Update test_config.json for playground-ayod-rag P1
* Update test_config.json: update P2
* Create test_data.json with test example
* Update .cspell.json: ignore jsonl file types
2024-03-15 10:02:03 +08:00
1803c7207d
Refine promptflow CI to support test_data.json config ( #2401 )
...
* refine promptflow-ci to support flow owner to config the test_data to run
* refine
* refine
* refine
* refine
* refine
* refine
* test
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
---------
Co-authored-by: Ge Gao <gega@microsoft.com>
2024-02-28 08:56:36 +08:00
8522414975
Refine promptflow CI to support test_data.json config ( #2401 )
...
* refine promptflow-ci to support flow owner to config the test_data to run
* refine
* refine
* refine
* refine
* refine
* refine
* test
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
* refine
---------
Co-authored-by: Ge Gao <gega@microsoft.com>
2024-02-28 08:56:36 +08:00
8fc1fee464
add rai chat quality&safety eval flow ( #2263 )
2024-02-05 17:25:36 -08:00
8ff684696b
add rai chat quality&safety eval flow ( #2263 )
2024-02-05 17:25:36 -08:00
7ad4206f19
Update RAG sample flows to use Index Lookup tool ( #2237 )
...
* update RAG sample flows
* update tests
* get oid for rbac
* revert
* print client id?
* revert
* spellcheck
* appeasing the spellchecker
* use index provisioned in CI workspace for lookup test
* add chjinche to spellchecker
* json escape parameter overrides
* bump versions
* revert promptflow-ci.py to avoid running into broken tests
2024-02-02 23:39:33 -08:00
55097aadb3
Update RAG sample flows to use Index Lookup tool ( #2237 )
...
* update RAG sample flows
* update tests
* get oid for rbac
* revert
* print client id?
* revert
* spellcheck
* appeasing the spellchecker
* use index provisioned in CI workspace for lookup test
* add chjinche to spellchecker
* json escape parameter overrides
* bump versions
* revert promptflow-ci.py to avoid running into broken tests
2024-02-02 23:39:33 -08:00
aafa427ae2
Add two promptflow models: count-cars and detect-defects ( #2070 )
...
* Add two promptflow models: count-cars and detect-defects
* Add ci test configs for count-cars and detect-defects
* Put "connection" into "inputs" for Azure OpenAI GPT-4 Turbo with Vision tool
---------
Co-authored-by: Zhi Zhou <zhizho@microsoft.com>
2024-02-02 14:04:03 +08:00
80ddb46be7
Add two promptflow models: count-cars and detect-defects ( #2070 )
...
* Add two promptflow models: count-cars and detect-defects
* Add ci test configs for count-cars and detect-defects
* Put "connection" into "inputs" for Azure OpenAI GPT-4 Turbo with Vision tool
---------
Co-authored-by: Zhi Zhou <zhizho@microsoft.com>
2024-02-02 14:04:03 +08:00
99230c5ac1
add rai qa quality and safety eval flow ( #2208 )
...
* add rai qa quality and safety eval flow
* add test_config for rai qa quality & safety flow
2024-01-31 08:00:40 -05:00
5fa67e60b1
add rai qa quality and safety eval flow ( #2208 )
...
* add rai qa quality and safety eval flow
* add test_config for rai qa quality & safety flow
2024-01-31 08:00:40 -05:00
77087529b8
Update Promptflow CI use config file for flow test settings. ( #2122 )
...
* use config file for dag node connections and inputs
* fix pep8
* fix missing samples.json
* fix
* fix qna-groundedness-eval config
* update log
* add config for playground-ayod-rag
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2024-01-17 09:28:15 +08:00
105e22f15b
Update Promptflow CI use config file for flow test settings. ( #2122 )
...
* use config file for dag node connections and inputs
* fix pep8
* fix missing samples.json
* fix
* fix qna-groundedness-eval config
* update log
* add config for playground-ayod-rag
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2024-01-17 09:28:15 +08:00
2843ef29bf
Use pull_request_target trigger for promptflow_ci ( #2082 )
...
* use pull request target
* add check
* update”
* update
* update
* update fail ci if continue is false
* update log
* update
* fix ci
* pep8 update
* remove last step
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2024-01-09 09:53:39 +08:00
06ca114bfb
Use pull_request_target trigger for promptflow_ci ( #2082 )
...
* use pull request target
* add check
* update”
* update
* update
* update fail ci if continue is false
* update log
* update
* fix ci
* pep8 update
* remove last step
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2024-01-09 09:53:39 +08:00
fdf056cc8a
Fix Promptflow CI multiple downloads, refine log. ( #2012 )
...
* fix ci
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2023-12-27 10:22:42 +08:00
e0e53d5646
Fix Promptflow CI multiple downloads, refine log. ( #2012 )
...
* fix ci
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2023-12-27 10:22:42 +08:00
d98c381554
Update Promptflow CI, use pfazure to submit flow run ( #1976 )
...
* use pfazure submit flow run
* fix format
* fix cspell
* pep8 update
* fix syntax check
* update
* update
* update
* update utils
* update
* fix comment
* update
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2023-12-21 10:34:48 +08:00
075d1fbc17
Update Promptflow CI, use pfazure to submit flow run ( #1976 )
...
* use pfazure submit flow run
* fix format
* fix cspell
* pep8 update
* fix syntax check
* update
* update
* update
* update utils
* update
* fix comment
* update
---------
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2023-12-21 10:34:48 +08:00
1db879b6f1
Add CI for promptflow examples ( #1837 )
...
Add CI for promptflow examples
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2023-12-15 10:45:18 +08:00
536d0e8deb
Add CI for promptflow examples ( #1837 )
...
Add CI for promptflow examples
Co-authored-by: Yuhang Liu <yuhaliu@microsoft.com>
2023-12-15 10:45:18 +08:00
Kelly
Billy Hu
vizhur
tongy-msft
jingyizhu99
Grace Bramley-Simmons
Ge Gao
Sean Murray
Anushree Kaipa Ramanath
Yao
qusongms
Adarsh-Ramanathan
Zhi Zhou
liuyuhang13