Vector_DB_with_LLM

vector_db_with_llm

vector_db_with_llm

FastApi是一個基於標準Python的現代化，快速（高性能），用於使用Python 3.8+構建API的Web框架。這是一個存儲庫，可以將記錄傳遞給Prometheus-Export應用程序。

Langchain（https://github.com/langchain-ai/langchain）是開發由大語言模型（LLMS）提供支持的應用程序的框架。 Langchain是基於大語言模型（LLMS）構建應用程序的開源框架。 LLM是大量的深度學習模型，可以在大量數據上進行對用戶查詢的響應的大量數據。例如，回答問題或從基於文本的提示中創建圖像。提示是人們用LLM尋求回复的疑問。

• 示例：https：//colab.research.google.com/github/i-am-shuan/learn-langchain/blob/main/main/langchain_rag_rag_example.ipynb， https://velog.io/
• 上
• ​https://hackernoon.com/lang/ko/ollama-python-%EB%B0%8FCHROMDB%EB%A5%BC- %B%EC%82%AC%EC%9A ％A9％ED％95％98％EC％97％AC-％EB％A1％9c％EC％AC％AC％EC％97％97％90％EC％84％9C-LLM％EC％9D％9D％84-％EC％84％A4％A4％EC％a 0％95％ED％95％98％EB％8A％94-％EB％8B％A8％EA％B3％B3％84％EB％B3％B3％84-％EA％B0％B0％80％EC％EC％9D％B4％B4％EB％93％9C％9C％9C％EB％a1％a1％9 C-％EB％82％98％EB％A7％8C％EC％9D％9D％98-％EB％9E％98％EA％B7％B7％B8-％EC％95％B1-％EB％A7％A7％A7％8C％EB％EB％93％A4％A4％A4％EA％EA％B8％B0
• 本地LLM：https：//github.com/firstpersoncode/local-rag?

ref=hackernoon.com vectordb（即，Milvus，Faiss（Facebook AI相似性搜索），Chroma，Qdrant，Pinecone，Pinecone，Pinecone）：vector Database（vectordb）是為vector database（vectordb）設計的，用於存儲和管理Vector Depplication和Machine和Machine，Ai I In Machine和AI。向量數據是指對象的數值表示，可用於相似性搜索，聚類和其他任務。 （參考：https：//krishna-yogik.medium.com/vectordb-tutorial-a-beginners-guide-06dc333333fac2f）

• vectordb
  • 建議系統的用例係統：通過基於其矢量表示的類似用戶或項目來為個性化建議提供動力。 （示例：電影，音樂或產品建議）
  • 圖像和視頻檢索：通過搜索類似的視覺功能來啟用基於內容的圖像和視頻檢索。
  • 自然語言處理（NLP）：使用Bert或Word2Vec等模型的向量嵌入來查找語義上相似的文本，文檔或查詢。 （示例：文檔聚類，情感分析，語義搜索）
  • 異常檢測：識別高維數據中的異常模式或異常值。 （欺詐檢測，網絡入侵檢測）

抹布（檢索增強生成）是一種AI技術，允許公司將其最新和最相關的專有數據直接嵌入其LLM提示中。

• 我們不僅在談論結構化數據，例如電子表格或關係數據庫。
• 我們的意思是檢索所有可用數據，包括非結構化數據：電子郵件，PDF，聊天日誌，社交媒體帖子和其他類型的信息，這些信息可能會導致更好的AI輸出。
• 簡而言之，RAG可以幫助公司從各種內部來源檢索並使用其數據，以獲得更好的生成AI結果。
• 為了達到這種提高的精度，RAG與專門類型的數據庫（稱為矢量數據庫）一起工作，以數字格式存儲數據，該數據對AI有意義，並在提示時檢索它。
• 如果沒有矢量數據庫來完成其工作，則RAG無法完成工作。
• 步驟（https://blog.naver.com/htk1019/223442628204）：文檔加載程序⮕文本splitter⮕文本分離器⮕嵌入vector Store（保存向量）⮕逆轉text restiver
• [1]文本塊 - 將數據分成小塊。
• [2]嵌入轉換 - 使用嵌入模型將每個文本塊轉換為嵌入。
• [3]向量存儲 - 將數據嵌入在矢量數據庫中。
• [4]文本映射 - 保存文本塊及其相應的嵌入，以備將來使用。
• [5]查詢嵌入 - 使用前面使用的相同嵌入模型將用戶的查詢轉換為嵌入。
• [6]數據庫查詢 - 使用查詢嵌入從矢量數據庫中檢索相關數據嵌入。
• [7]相似性搜索 - 確定最相似的文本塊，執行大約最近的鄰居（ANN）搜索。
• [8]上下文映射 - 將檢索的向量映射到相應的文本塊。
• [9] LLM響應 - 將提示中檢索到的上下文以及查詢與LLM一起獲取答案。這樣可以確保答案僅依賴於給定的上下文。

Apache Flink：Apache Kafka和Apache Flink是大數據和流處理中的兩個強大工具。儘管Kafka以其強大的消息傳遞系統而聞名，但Flink在實時流處理和分析方面很好。

• Apache Kafka：分布式流媒体平台，用于实时数据流的消息系统，Publish-Subscriber消息传递系统，主题/生产者/消费者
• Apache Flink：分布式流处理框架，流处理和分析，事件驱动/实时流程流程，数据播种/流程/流处理/流处理/窗口/窗口/窗口窗口/窗口窗口/窗口窗口/窗口（https://medium.com/@priyankbhandia_24919/apache-flink-for-for-data-enrichment-6118d48de04，https://yenaworldblog.wordpress.wordpress.com/2018/06/06/06/20/20/flink-install-ecc--install-cec------ulin-cec- ec- ec- ec- ec-umpis-umpis-umpin-98/d98/ https://medium.com/@aaron.cpsh/designing-streaming-data-pipeline-with-pipeline-with-apache-flink-and-kafka-a75c75c75d55918）apache
  • flink是一个框架和分布式处理引擎，用于对有限和没有绑定的数据流进行状态计算。可以將有界的數據流視為批處理處理，而無界的數據流可以被認為是流處理，因為常規討論的
  • Pyflink是Apache Flink的Python API。它允許用戶在Python中編寫Flink程序，並在Flink群集上執行它們。
  • 可以從各種來源檢索來源和接收器：
    • 文件系統（源/接收器）
    • apache kafka（source/sink）
    • apache cassandra（sink）
    • amazon kinesis streams（source/sink
    • ）elasticsearch（sink）
    • hadoop filesystem（sink
    ）
    • hadoop filesystem（
    • sink）rabbitmq（
    sink
    • ）rabbitmq
    • （source/sink sink）apache nifi（sink）twitter api
    • （sink
  • ） Flink : https://thingsolver.com/blog/streaming-analytics-in-banking-how-to-start-with-apache-flink-and-kafka-in-7-steps/, https://github.com/apache/flink/blob/master/flink-python/pyflink/examples/datastream/connectors/elasticsearch.py​​, https://github.com/apache/flink/blob/master/flink-python/pyflink/exampleas/datastream/datastream/datastream/connectors/kafka_json_jon_format.py

slealllit是一個開放式python python python forthon

• https://github.com/streamlit/llm-examples，https://pypi.org/project/project/streamlit-chat/
• shartlit install＆run

pip install streamlit pip install streamlit-chat streamlit run [streamlit-filenam.py] [--server.port 30001] streamlit run app.py

• App測試：https：//github.com/streamlit/llm--examples/blob/main/.github/workflows/app-testing.yml
• sumpllians unignts-dev.txt

black==23.3.0 mypy==1.4.1 pre-commit==3.3.3 watchdog pytest

Gradio（https://www.gradio.app/guides/quickstart）：Gradio是一個開放式Python軟件包，可讓您快速為機器學習模型，API或任何任意的Python功能構建演示或Web應用程序。然後，您可以在短短幾秒鐘內使用Gradio的內置共享功能共享指向演示或Web應用程序的鏈接。

• Run : ./gradio-start.sh
• Installation : We recommend installing Gradio using pip, which is included by default in Python ( pip install --upgrade gradio )

Elasticsearch Gen-AI : https://github.com/elastic/elasticsearch-labs/blob/main/notebooks/generative-ai/chatbot.ipynb

• Codespaces （https://github.com/features/codespaces，https://velog.io/@profile_exe/github-codespaces）：github codespaces可以使您更快地使用GitHub的原始配置，安全的，安全的雲開發環境。

• Pyautogui讓您的Python腳本控制鼠標和鍵盤，以自動與其他應用程序進行交互。 API設計為簡單。 Pyautogui在Windows，MacOS和Linux上工作，並在Python 2和3上運行。要與PIP安裝，運行pip install pyautogui 。有關更多詳細信息（https://pyautogui.readthedocs.io/en/latest/），請參見安裝頁面

import pyautogui import time while True: print(pyautogui.position ()) pyautogui.moveTo(100,200) pyautogui.click(100, 200) # pyautogui.moveTo(200,200, duration=0.5) time.sleep(10)

• ./jupyter-notebook.sh
  • -L
  可用主題：Chesterish 3級GruvBoxd gruvboxl monokai oceans16 oneDork solarizedd solarizeD（.venv）

python v3.9安裝

• gunicorn/fastapi：https：//chaechae..life/blife/blog/bastapi/fastapi-deployment-deployment-deployment-gnoicorn
• #google_voogle_vignette p.1111111111111111111111111 （https://datamoney.tistory.com/378）sudo

sudo yum install gcc openssl-devel bzip2-devel libffi-devel zlib-devel git wget https://www.python.org/ftp/python/3.9.0/Python-3.9.0.tgz tar –zxvf Python-3.9.0.tgz or tar -xvf Python-3.9.0.tgz cd Python-3.9.0 ./configure --libdir=/usr/lib64 sudo make sudo make altinstall # python3 -m venv .venv --without-pip sudo yum install python3-pip sudo ln -s /usr/lib64/python3.9/lib-dynload/ /usr/local/lib/python3.9/lib-dynload # -- From Python ^3.10 , It need to be installed openssl # openssl cd /usr/local/src wget https://www.openssl.org/source/openssl-1.1.1t.tar.gz tar xvf openssl-1.1.1t.tar.gz cd openssl-1.1.1t/ ./config --prefix=/usr/local/ssl --openssldir=/usr/local/ssl shared zlib make sudo make install export LDFLAGS= " -L/usr/local/ssl/lib " export CPPFLAGS= " -I/usr/local/ssl/include " # openssl확인 /usr/local/ssl/bin/openssl version export LD_LIBRARY_PATH=/usr/local/ssl/lib: $LD_LIBRARY_PATH echo $LD_LIBRARY_PATH sudo yum install gcc openssl-devel bzip2-devel libffi-devel zlib-devel git wget https://www.python.org/ftp/python/3.11.0/Python-3.11.0.tgz tar –zxvf Python-3.11.0.tgz or tar -xvf Python-3.11.0.tgz cd Python-3.11.0 # --with-openssl-rpath=auto 옵션을 추가하여 파이썬이 자동으로 올바른 OpenSSL 라이브러리 경로를 찾도록 함 # ./configure --libdir=/usr/lib64 --with-openssl=/usr/local/ssl --with-openssl-rpath=auto ./configure --libdir=/usr/lib64 --with-openssl=/usr/bin/ssl --with-openssl-rpath=auto sudo make sudo make altinstall # -- Error occurs when installing packages via pip like below (.venv) -bash-4.2$ pip install elasticsearch==7.13 WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available. WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by ' SSLError("Can ' t connect to HTTPS URL because the SSL module is not available. " )': /simple/elasticsearch/ WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError( " Can ' t connect to HTTPS URL because the SSL module is not available.") ' : /simple/elasticsearch/ ERROR: Operation cancelled by user # -- python -m venv .venv source .venv/bin/activate # -- Swagger pip install poetry poetry add fastapi poetry add uvicorn poetry add gunicorn poetry add pytz poetry add httpx poetry add pytest poetry add pytest-cov poetry add requests poetry add pyyaml poetry add elasticsearch==7.13 poetry add python-dotenv poetry add jupyter # -- # -- Vector poetry config virtualenvs.in-project true pip install poetry poetry init poetry add openai langchain langchainhub tiktoken chromadb langchain-community bs4 python-dotenv poetry add sentence-transformers poetry add pypdf poetry add docx2txt poetry add faiss-cpu poetry add requests pip install --q openai langchain langchainhub tiktoken chromadb langchain-community bs4 # when error occur like this # ImportError: urllib3 v2 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'OpenSSL 1.0.2k-fips 26 Jan 2017'. See: https://github.com/urllib3/urllib3/issues/2168 pip install urllib3==1.26.18 pip install pytz pip install requests==2.27.1

API Run

• Start service using ./service-start.sh
• FYI) Install library with setup.py like pip install git+https://github.com/jm/git_pip_install.git or git+https://oss.navercorp.com/nsml/nsml_notebook.git@branch_name （https://liferecorde.tistory.com/49，https://newsight.tistory.com/296）
• 使用langchain.document_loaders提取帶有tika（ ./Langchain/workflow/ workflow/）

curl -X ' POST '  ' http://localhost:7001/vector/uploadfile '  -H ' accept: application/json '  -H ' Content-Type: multipart/form-data '  -F ' [email protected];type=application/msword ' { " filename " : [ { " index " : { " _index " : " test_context " , " _type " : " search " } }, { " ES_UPLOADED " : " JSON_FORMAT " , " CONTENT " : " This is a test Word document for the TemplatePackage example site. " } ] }

• 使用python ./Langchain/workflow/text_loader.py

*** type : < class ' list ' > / len : 1 data : [Document(metadata={'source': 'C:\Users\euiyoung.hwang\Git_Workspace\Vector_DB_with_LLM/Data/Sample.hwp'}, page_content='KTX 노선도ﺎĀ Ā※ KTX 소요 시간과 운임은 철도청의 사정에 따라 변동할 수 있습니다.Ā서울용산광명Ā천안아산대전서대전동대구익산논산김제밀양정읍구포장성광주부산광주송정나주목포ĀྠĀ 경부선 ྠĀ 호남선ĀĀKTX 소요시간호남선 (서울~천안아산 경부선과 동일)서울서대전논산익산김제정읍장성광주광주송정나주목포시:분6:226:517:15-7:38--8:06-8:38경부선서울용산광명천안아산대전동대구밀양구포부산시:분5:305:456:246:307:187:498:148:27KTX 운임안내최저운임8,100원 (월~목 요금제 기준)호남선 (단위:원)행신8,1008,10015,10024,50026,40028,80031,20032,80035,00037,10039,00040,40044,80040,000용산8,10013,30022,70024,70027,20029,60031,20033,40036,30037,50038,90043,30038,400광명11,30020,70022,60025,10028,60029,40031,60034,50036,40037,10041,50036,700천안아산9,40011,40014,00017,70019,10021,70024,70026,60027,70032,20027,300서대전8,1008,1008,30010,00012,70015,90018,10019,70024,30019,300계룡8,1008,1008,10010,70014,00016,10017,70022,50017,400논산8,1008,1008,10011,40013,50015,10020,20014,800익산8,1008,1008,1009,80011,40016,50011,100김제8,1008,1008,1009,70014,8009,300정읍8,1008,1008,10012,1008,100장성8,1008,1008,9008,100광주송정8,1008,100-나주8,100-목포-광주경부선 (단위:원)행신8,1008,10014,10022,80039,70044,20047,80049,100서울8,10012,70021,40038,40043,00046,60047,900광명10,50019,20036,50041,00044,60046,000천안아산8,70025,60029,40032,90034,200대전16,90022,10025,30026,700동대구8,1009,30010,800밀양8,1008,100구포8,100부산')] page_content : KTX 노선도ﺎĀ Ā※ KTX 소요 시간과 운임은 철도청의 사정에 따라 변동할 수 있습니다.Ā서울용산광명Ā천안아산대전서대전동대구익산논산김제밀양정읍구포장성광주부산광주송정나주목포ĀྠĀ 경부선 ྠĀ 호남선ĀĀKTX 소요시간호남선 (서울~천안아산 경부선과 동일)서울서대전논산익산김제정읍장성광주광주송정나주목포시:분6:226:517:15-7:38--8:06-8:38경부선서울용산광명천안아산대전동대구밀양구포부산시:분5:305:456:246:307:187:498:148:27KTX 운임안내최저운임8,100원 (월~목 요금제 기준)호남선 (단위:원)행신8,1008,10015,10024,50026,40028,80031,20032,80035,00037,10039,00040,40044,80040,000용산8,10013,30022,70024,70027,20029,60031,20033,40036,30037,50038,90043,30038,400광명11,30020,70022,60025,10028,60029,40031,60034,50036,40037,10041,50036,700천안아산9,40011,40014,00017,70019,10021,70024,70026,60027,70032,20027,300서대전8,1008,1008,30010,00012,70015,90018,10019,70024,30019,300계룡8,1008,1008,10010,70014,00016,10017,70022,50017,400논산8,1008,1008,10011,40013,50015,10020,20014,800익산8,1008,1008,1009,80011,40016,50011,100김제8,1008,1008,1009,70014,8009,300정읍8,1008,1008,10012,1008,100장성8,1008,1008,9008,100광주송정8,1008,100-나주8,100-목포-광주경부선 (단위:원)행신8,1008,10014,10022,80039,70044,20047,80049,100서울8,10012,70021,40038,40043,00046,60047,900광명10,50019,20036,50041,00044,60046,000천안아산8,70025,60029,40032,90034,200대전16,90022,10025,30026,700동대구8,1009,30010,800밀양8,1008,100구포8,100부산 *** [ { " index " : { " _index " : " test_context " , " _type " : " search " } }, { " ES_UPLOADED " : " JSON_FORMAT " , "CONTENT": "KTX 노선도ﺎĀ Ā※ KTX 소요 시간과 운임은 철도청의 사정에 따라 변동할 수 있습니다.Ā서울용산광명Ā천안아산대전서대전동대구익산논산김제밀양정읍구포장성광주부산광주송정나주목포ĀྠĀ 경부선 ྠĀ 호남선ĀĀKTX 소요시간호남선 (서울~천안아산 경부선과 동일)서울서대전논산익산김제정읍장성광주광주송정나주목포시:분6:226:517:15-7:38--8:06-8:38경부선서울용산광명천안아산대전동대구밀양구포부산시:분5:305:456:246:307:187:498:148:27KTX 운임안내최저운임8,100원 (월~목 요금제 기준)호남선 (단위:원)행신8,1008,10015,10024,50026,40028,80031,20032,80035,00037,10039,00040,40044,80040,000용산8,10013,30022,70024,70027,20029,60031,20033,40036,30037,50038,90043,30038,400광명11,30020,70022,60025,10028,60029,40031,60034,50036,40037,10041,50036,700천안아산9,40011,40014,00017,70019,10021,70024,70026,60027,70032,20027,300서대전8,1008,1008,30010,00012,70015,90018,10019,70024,30019,300계룡8,1008,1008,10010,70014,00016,10017,70022,50017,400논산8,1008,1008,10011,40013,50015,10020,20014,800익산8,1008,1008,1009,80011,40016,50011,100김제8,1008,1008,1009,70014,8009,300정읍8,1008,1008,10012,1008,100장성8,1008,1008,9008,100광주송정8,1008,100-나주8,100-목포-광주경부선 (단위:원)행신8,1008,10014,10022,80039,70044,20047,80049,100서울8,10012,70021,40038,40043,00046,60047,900광명10,50019,20036,50041,00044,60046,000천안아산8,70025,60029,40032,90034,200대전16,90022,10025,30026,700동대구8,1009,30010,800밀양8,1008,100구포8,100부산" } ]

啟動並提取文本。

*** type : < class ' list ' > / len : 1 data : [Document(metadata={'source': 'C:\Users\euiyoung.hwang\Git_Workspace\Vector_DB_with_LLM/Data/Sample.hwp'}, page_content='KTX 노선도ﺎĀ Ā※ KTX 소요 시간과 운임은 철도청의 사정에 따라 변동할 수 있습니다.Ā서울용산광명Ā천안아산대전서대전동대구익산논산김제밀양정읍구포장성광주부산광주송정나주목포ĀྠĀ 경부선 ྠĀ 호남선ĀĀKTX 소요시간호남선 (서울~천안아산 경부선과 동일)서울서대전논산익산김제정읍장성광주광주송정나주목포시:분6:226:517:15-7:38--8:06-8:38경부선서울용산광명천안아산대전동대구밀양구포부산시:분5:305:456:246:307:187:498:148:27KTX 운임안내최저운임8,100원 (월~목 요금제 기준)호남선 (단위:원)행신8,1008,10015,10024,50026,40028,80031,20032,80035,00037,10039,00040,40044,80040,000용산8,10013,30022,70024,70027,20029,60031,20033,40036,30037,50038,90043,30038,400광명11,30020,70022,60025,10028,60029,40031,60034,50036,40037,10041,50036,700천안아산9,40011,40014,00017,70019,10021,70024,70026,60027,70032,20027,300서대전8,1008,1008,30010,00012,70015,90018,10019,70024,30019,300계룡8,1008,1008,10010,70014,00016,10017,70022,50017,400논산8,1008,1008,10011,40013,50015,10020,20014,800익산8,1008,1008,1009,80011,40016,50011,100김제8,1008,1008,1009,70014,8009,300정읍8,1008,1008,10012,1008,100장성8,1008,1008,9008,100광주송정8,1008,100-나주8,100-목포-광주경부선 (단위:원)행신8,1008,10014,10022,80039,70044,20047,80049,100서울8,10012,70021,40038,40043,00046,60047,900광명10,50019,20036,50041,00044,60046,000천안아산8,70025,60029,40032,90034,200대전16,90022,10025,30026,700동대구8,1009,30010,800밀양8,1008,100구포8,100부산')] page_content : KTX 노선도ﺎĀ Ā※ KTX 소요 시간과 운임은 철도청의 사정에 따라 변동할 수 있습니다.Ā서울용산광명Ā천안아산대전서대전동대구익산논산김제밀양정읍구포장성광주부산광주송정나주목포ĀྠĀ 경부선 ྠĀ 호남선ĀĀKTX 소요시간호남선 (서울~천안아산 경부선과 동일)서울서대전논산익산김제정읍장성광주광주송정나주목포시:분6:226:517:15-7:38--8:06-8:38경부선서울용산광명천안아산대전동대구밀양구포부산시:분5:305:456:246:307:187:498:148:27KTX 운임안내최저운임8,100원 (월~목 요금제 기준)호남선 (단위:원)행신8,1008,10015,10024,50026,40028,80031,20032,80035,00037,10039,00040,40044,80040,000용산8,10013,30022,70024,70027,20029,60031,20033,40036,30037,50038,90043,30038,400광명11,30020,70022,60025,10028,60029,40031,60034,50036,40037,10041,50036,700천안아산9,40011,40014,00017,70019,10021,70024,70026,60027,70032,20027,300서대전8,1008,1008,30010,00012,70015,90018,10019,70024,30019,300계룡8,1008,1008,10010,70014,00016,10017,70022,50017,400논산8,1008,1008,10011,40013,50015,10020,20014,800익산8,1008,1008,1009,80011,40016,50011,100김제8,1008,1008,1009,70014,8009,300정읍8,1008,1008,10012,1008,100장성8,1008,1008,9008,100광주송정8,1008,100-나주8,100-목포-광주경부선 (단위:원)행신8,1008,10014,10022,80039,70044,20047,80049,100서울8,10012,70021,40038,40043,00046,60047,900광명10,50019,20036,50041,00044,60046,000천안아산8,70025,60029,40032,90034,200대전16,90022,10025,30026,700동대구8,1009,30010,800밀양8,1008,100구포8,100부산 *** [ { " index " : { " _index " : " test_context " , " _type " : " search " } }, { " ES_UPLOADED " : " JSON_FORMAT " , "CONTENT": "KTX 노선도ﺎĀ Ā※ KTX 소요 시간과 운임은 철도청의 사정에 따라 변동할 수 있습니다.Ā서울용산광명Ā천안아산대전서대전동대구익산논산김제밀양정읍구포장성광주부산광주송정나주목포ĀྠĀ 경부선 ྠĀ 호남선ĀĀKTX 소요시간호남선 (서울~천안아산 경부선과 동일)서울서대전논산익산김제정읍장성광주광주송정나주목포시:분6:226:517:15-7:38--8:06-8:38경부선서울용산광명천안아산대전동대구밀양구포부산시:분5:305:456:246:307:187:498:148:27KTX 운임안내최저운임8,100원 (월~목 요금제 기준)호남선 (단위:원)행신8,1008,10015,10024,50026,40028,80031,20032,80035,00037,10039,00040,40044,80040,000용산8,10013,30022,70024,70027,20029,60031,20033,40036,30037,50038,90043,30038,400광명11,30020,70022,60025,10028,60029,40031,60034,50036,40037,10041,50036,700천안아산9,40011,40014,00017,70019,10021,70024,70026,60027,70032,20027,300서대전8,1008,1008,30010,00012,70015,90018,10019,70024,30019,300계룡8,1008,1008,10010,70014,00016,10017,70022,50017,400논산8,1008,1008,10011,40013,50015,10020,20014,800익산8,1008,1008,1009,80011,40016,50011,100김제8,1008,1008,1009,70014,8009,300정읍8,1008,1008,10012,1008,100장성8,1008,1008,9008,100광주송정8,1008,100-나주8,100-목포-광주경부선 (단위:원)행신8,1008,10014,10022,80039,70044,20047,80049,100서울8,10012,70021,40038,40043,00046,60047,900광명10,50019,20036,50041,00044,60046,000천안아산8,70025,60029,40032,90034,200대전16,90022,10025,30026,700동대구8,1009,30010,800밀양8,1008,100구포8,100부산" } ]

• REST API URL： http://localhost:7001/docs

Pytest

• Go to virtual enviroment using source .venv/bin/activate
• Run this command manually: poetry run py.test -v --junitxml=test-reports/junit/pytest.xml --cov-report html --cov tests/ or ./pytest.sh

$ ./pytest.sh tests t est_api.py::test_skip SKIPPED (no way of currently testing this) [ 50%] tests t est_api.py::test_api PASSED [100%] ---------- coverage: platform win32, python 3.11.7-final-0 ----------- Name Stmts Miss Cover Missing ---------------------------------------------------------------- config c onfig.py 8 4 50% 16-20, 33 config l og_config.py 32 1 97% 42 controller _ _init__.py 0 0 100% controller c luster_controller.py 14 0 100% injector.py 25 0 100% main.py 23 9 61% 38-57, 69 service _ _init__.py 0 0 100% service e s_search_handler.py 139 103 26% 32-88, 131-132, 139-155, 160-173, 178-191, 196-213, 219-254, 259-271, 276-287, 292-304, 309-315 service e s_util.py 21 16 24% 5-11, 16-19, 24-35, 40-41 service q uery_builder.py 42 27 36% 21-40, 48-51, 64-83, 89-98, 102-137 service s tatus_handler.py 13 2 85% 12, 19 tests _ _init__.py 0 0 100% tests c onftest.py 8 0 100% tests t est_api.py 9 1 89% 7 ---------------------------------------------------------------- TOTAL 334 163 51% $

CI/CD環境

• Circleci（ ./circleci/config.yml config.yml）：CircleCi是一個連續的集成和連續的交付平台，可幫助軟件團隊更加聰明，更快地工作。借助CircleCi，每個提交都會在我們的平台中啟動一項新工作，並且代碼將被構建，測試和部署。
• github操作（ ./.github/workflows/build-and-test.yml Action是一個連續的集成和連續交付（CI/CD）平台（CI/CD）平台，使您可以自動化構建，測試和部署管道。您可以創建工作流程，以構建和測試向存儲庫的每個拉請請求，或將合併後的拉請請求部署到生產中。

註冊服務

• sudo服務vector_interface_api status/stop/start/start/restart

# -- /etc/systemd/system/vector_interface_api.service [Unit] Description=Swagger ES Service [Service] User=devuser Group=devuser Type=simple ExecStart=/bin/bash /home/devuser/Git_Repo/service-start.sh ExecStop= /usr/bin/killall vector_interface_api [Install] WantedBy=default.target # Service command sudo systemctl daemon-reload sudo systemctl start vector_interface_api.service sudo systemctl status vector_interface_api.service sudo systemctl stop vector_interface_api.service sudo service vector_interface_api status/stop/start