Home
Softono
a

awslabs

Professional software vendor delivering innovative solutions on the Softono platform. Specialized in both open-source and proprietary software development.

Total Products
4

Software by awslabs

gluonts
Open Source

gluonts

<img class="hide-on-website" height="100px" src="https://ts.gluon.ai/dev/_static/gluonts.svg"> # GluonTS - Probabilistic Time Series Modeling in Python [![PyPI](https://img.shields.io/pypi/v/gluonts.svg?style=flat-square&color=b75347)](https://pypi.org/project/gluonts/) [![GitHub](https://img.shields.io/github/license/awslabs/gluonts.svg?style=flat-square&color=df7e66)](./LICENSE) [![Static](https://img.shields.io/static/v1?label=docs&message=stable&color=edc775&style=flat-square)](https://ts.gluon.ai/) [![Static](https://img.shields.io/static/v1?label=docs&message=dev&color=edc775&style=flat-square)](https://ts.gluon.ai/dev/) [![PyPI Downloads](https://static.pepy.tech/badge/gluonts/month)](https://pepy.tech/projects/gluonts) **📢 BREAKING NEWS**: We released **Chronos**, a suite of pretrained models for zero-shot time series forecasting. Chronos can generate accurate probabilistic predictions for new time series not seen during training. Check it out [here](https://github.com/amazon-science/chronos-forecasting)! GluonTS is a Python package for probabilistic time series modeling, focusing on deep learning based models, based on [PyTorch](https://pytorch.org) and [MXNet](https://mxnet.apache.org). ## Installation GluonTS requires Python 3.7 or newer, and the easiest way to install it is via `pip`: ```bash # install with support for torch models pip install "gluonts[torch]" # install with support for mxnet models pip install "gluonts[mxnet]" ``` See the [documentation](https://ts.gluon.ai/stable/getting_started/install.html) for more info on how GluonTS can be installed. ## Simple Example To illustrate how to use GluonTS, we train a DeepAR-model and make predictions using the airpassengers dataset. The dataset consists of a single time series of monthly passenger numbers between 1949 and 1960. We train the model on the first nine years and make predictions for the remaining three years. ```py import pandas as pd import matplotlib.pyplot as plt from gluonts.dataset.pandas import PandasDataset from gluonts.dataset.split import split from gluonts.torch import DeepAREstimator # Load data from a CSV file into a PandasDataset df = pd.read_csv( "https://raw.githubusercontent.com/AileenNielsen/" "TimeSeriesAnalysisWithPython/master/data/AirPassengers.csv", index_col=0, parse_dates=True, ) dataset = PandasDataset(df, target="#Passengers") # Split the data for training and testing training_data, test_gen = split(dataset, offset=-36) test_data = test_gen.generate_instances(prediction_length=12, windows=3) # Train the model and make predictions model = DeepAREstimator( prediction_length=12, freq="M", trainer_kwargs={"max_epochs": 5} ).train(training_data) forecasts = list(model.predict(test_data.input)) # Plot predictions plt.plot(df["1954":], color="black") for forecast in forecasts: forecast.plot() plt.legend(["True values"], loc="upper left", fontsize="xx-large") plt.show() ``` ![[train-test]](https://ts.gluon.ai/static/README/forecasts.png) Note, the forecasts are displayed in terms of a probability distribution and the shaded areas represent the 50% and 90% prediction intervals. ## Contributing If you wish to contribute to the project, please refer to our [contribution guidelines](https://github.com/awslabs/gluonts/tree/dev/CONTRIBUTING.md). ## Citing If you use GluonTS in a scientific publication, we encourage you to add the following references to the related papers, in addition to any model-specific references that are relevant for your work: ```bibtex @article{gluonts_jmlr, author = {Alexander Alexandrov and Konstantinos Benidis and Michael Bohlke-Schneider and Valentin Flunkert and Jan Gasthaus and Tim Januschowski and Danielle C. Maddix and Syama Rangapuram and David Salinas and Jasper Schulz and Lorenzo Stella and Ali Caner Türkmen and Yuyang Wang}, title = {{GluonTS: Probabilistic and Neural Time Series Modeling in Python}}, journal = {Journal of Machine Learning Research}, year = {2020}, volume = {21}, number = {116}, pages = {1-6}, url = {http://jmlr.org/papers/v21/19-820.html} } ``` ```bibtex @article{gluonts_arxiv, author = {Alexandrov, A. and Benidis, K. and Bohlke-Schneider, M. and Flunkert, V. and Gasthaus, J. and Januschowski, T. and Maddix, D. C. and Rangapuram, S. and Salinas, D. and Schulz, J. and Stella, L. and Türkmen, A. C. and Wang, Y.}, title = {{GluonTS: Probabilistic Time Series Modeling in Python}}, journal = {arXiv preprint arXiv:1906.05264}, year = {2019} } ``` ## Links ### Documentation * [Documentation (stable)](https://ts.gluon.ai/stable/) * [Documentation (development)](https://ts.gluon.ai/dev/) ### References * [JMLR MLOSS Paper](http://www.jmlr.org/papers/v21/19-820.html) * [ArXiv Paper](https://arxiv.org/abs/1906.05264) * [Collected Papers from the group behind GluonTS](https://github.com/awslabs/gluonts/tree/dev/REFERENCES.md): a bibliography. ### Tutorials and Workshops * [Tutorial at IJCAI 2021 (with videos)](https://lovvge.github.io/Forecasting-Tutorial-IJCAI-2021/) with [YouTube link](https://youtu.be/AB3I9pdT46c). * [Tutorial at WWW 2020 (with videos)](https://lovvge.github.io/Forecasting-Tutorial-WWW-2020/) * [Tutorial at SIGMOD 2019](https://lovvge.github.io/Forecasting-Tutorials/SIGMOD-2019/) * [Tutorial at KDD 2019](https://lovvge.github.io/Forecasting-Tutorial-KDD-2019/) * [Tutorial at VLDB 2018](https://lovvge.github.io/Forecasting-Tutorial-VLDB-2018/) * [Neural Time Series with GluonTS](https://youtu.be/beEJMIt9xJ8) * [International Symposium of Forecasting: Deep Learning for Forecasting workshop](https://lostella.github.io/ISF-2020-Deep-Learning-Workshop/)

ML Frameworks
5.2K Github Stars
generative-ai-cdk-constructs
Open Source

generative-ai-cdk-constructs

# AWS Generative AI CDK Constructs ![Stability: Experimental](https://img.shields.io/badge/stability-Experimental-important.svg?style=for-the-badge) > All classes are under active development and subject to non-backward compatible changes or removal in any > future version. These are not subject to the [Semantic Versioning](https://semver.org/) model. > This means that while you may use them, you may need to update your source code when upgrading to a newer version of this package. --- [![View on Construct Hub](https://constructs.dev/badge?package=generative-ai-cdk-constructs)](https://constructs.dev/packages/@cdklabs/generative-ai-cdk-constructs) [![PyPI version](https://img.shields.io/pypi/v/cdklabs.generative-ai-cdk-constructs)](https://pypi.org/project/cdklabs.generative-ai-cdk-constructs/) [![npm version](https://img.shields.io/npm/v/@cdklabs/generative-ai-cdk-constructs)](https://www.npmjs.com/package/@cdklabs/generative-ai-cdk-constructs) [![NuGet Version](https://img.shields.io/nuget/v/Cdklabs.GenerativeAiCdkConstructs)](https://nuget.info/packages/Cdklabs.GenerativeAiCdkConstructs) [![Maven Central Version](https://img.shields.io/maven-central/v/io.github.cdklabs/generative-ai-cdk-constructs)](https://central.sonatype.com/artifact/io.github.cdklabs/generative-ai-cdk-constructs) [![Go Version](https://img.shields.io/github/v/tag/awslabs/generative-ai-cdk-constructs?label=go&color=orange)](https://pkg.go.dev/github.com/cdklabs/generative-ai-cdk-constructs-go/generativeaicdkconstructs) [![Terraform Amazon Bedrock Module](https://img.shields.io/badge/Terraform-7B42BC?style=flat&logo=terraform&label=bedrock%20module)](https://registry.terraform.io/modules/aws-ia/bedrock/aws/latest) [![Terraform Amazon OpenSearch Serverless Module](https://img.shields.io/badge/Terraform-7B42BC?style=flat&logo=terraform&label=opensearchserverless%20module)](https://registry.terraform.io/modules/aws-ia/opensearch-serverless/aws/latest) [![Terraform Amazon SageMaker Endpoint Module](https://img.shields.io/badge/Terraform-7B42BC?style=flat&logo=terraform&label=sagemaker%20endpoint%20module)](https://registry.terraform.io/modules/aws-ia/sagemaker-endpoint/aws/latest) [![Terraform Streamlit Module](https://img.shields.io/badge/Terraform-7B42BC?style=flat&logo=terraform&label=streamlit%20module)](https://registry.terraform.io/modules/aws-ia/serverless-streamlit-app/aws/latest) ## Table of contents - [Introduction](#introduction) - [CDK Versions](#cdk-versions) - [Contributing](#contributing) - [Design guidelines and Development guide](#design-guidelines-and-development-guide) - [Getting Started](#getting-started) - [Catalog](#catalog) - [Sample Use Cases](#sample-use-cases) - [Additional Resources](#additional-resources) - [Contributors](#contributors) - [Operational Metrics Collection](#operational-metrics-collection) - [Roadmap](#roadmap) - [Deprecation](#deprecation) - [License](#license) - [Legal Disclaimer](#legal-disclaimer) ## Introduction The AWS Generative AI Constructs Library is an open-source extension of the [AWS Cloud Development Kit (AWS CDK)](https://docs.aws.amazon.com/cdk/v2/guide/home.html) that provides multi-service, well-architected patterns for quickly defining solutions in code to create predictable and repeatable infrastructure, called [constructs](https://docs.aws.amazon.com/cdk/v2/guide/constructs.html). The goal of AWS Generative AI CDK Constructs is to help developers build generative AI solutions using pattern-based definitions for their architecture. The patterns defined in AWS Generative AI CDK Constructs are high level, multi-service abstractions of AWS CDK constructs that have default configurations based on well-architected best practices. The library is organized into logical modules using object-oriented techniques to create each architectural pattern model. ## CDK Versions AWS Generative AI CDK Constructs and the AWS CDK are independent teams and have different release schedules. Each release of AWS Generative AI CDK Constructs is built against a specific version of the AWS CDK. The [CHANGELOG.md](./CHANGELOG.md) file lists the CDK version associated with each AWS Generative AI Constructs release. For instance, AWS Generative AI CDK Constructs v0.0.0 was built against AWS CDK v2.96.2. This means that to use AWS Generative AI CDK Constructs v0.0.0, your application must include AWS CDK v2.96.2 or later. You can continue to use the latest AWS CDK versions and upgrade the your AWS Generative AI CDK Constructs version when new releases become available. ## Contributing Contributions of all kinds are welcome! Check out our [contributor guide](./CONTRIBUTING.md) ## Design guidelines and Development guide If you want to add a new construct to the library, check out our [design guidelines](./DESIGN_GUIDELINES.md), then follow the [development guide](./DEVELOPER_GUIDE.md) ## Getting Started <details> <summary><i>TypeScript</i></summary> - Create or use an existing CDK application in TypeScript. - `cdk init app --language typescript` - Run `npm install @cdklabs/generative-ai-cdk-constructs` - The package should be added to your package.json. - Import the library: - `import * as genai from '@cdklabs/generative-ai-cdk-constructs';` </details> <details> <summary><i>Python</i></summary> - Create or use an existing CDK application in Python - `cdk init app --language python` - Install the package: - `pip install cdklabs.generative-ai-cdk-constructs` - Import the library: - `import cdklabs.generative_ai_cdk_constructs` </details> <details> <summary><i>NuGet</i></summary> - Create or use an existing CDK application in Python - `cdk init app --language csharp` - Install the package while in the Visual Studio project: - `dotnet add package CdkLabs.GenerativeAICdkConstructs` - Use the namespace: - `using Cdklabs.GenerativeAiCdkConstructs;` </details> <details> <summary><i>Go</i></summary> - Create or use an existing CDK application in Python - `cdk init app --language go` - Get the module: - `go get github.com/cdklabs/generative-ai-cdk-constructs-go/generativeaicdkconstructs` - Import the library: - `import "github.com/cdklabs/generative-ai-cdk-constructs-go/generativeaicdkconstructs"` _NOTE: The [Go distribution repository](https://github.com/cdklabs/generative-ai-cdk-constructs-go), distributes the JSII tar gzipped versioned source from the [source repository](https://github.awslabs/generative-ai-cdk-constructs)_ </details> <details> <summary><i>Java</i></summary> - Create or use an existing CDK application in Java - `cdk init app --language java` - Add the dependency into the `pom.xml` ``` <dependency> <groupId>io.github.cdklabs</groupId> <artifactId>generative-ai-cdk-constructs</artifactId> <version>Get the latest version and insert it here</version> </dependency> ``` </details> Refer to the documentation for additional guidance on a particular construct: [Catalog](#catalog) ## Catalog The following constructs are available in the library: ### L3 constructs | **Construct** |Description| AWS Services used | |:-------------|:-------------|:-------------| | [SageMaker model deployment (JumpStart)](./src/patterns/gen-ai/aws-model-deployment-sagemaker/README.md) | Deploy a foundation model from Amazon SageMaker JumpStart to an Amazon SageMaker endpoint. | Amazon SageMaker | | [SageMaker model deployment (Hugging Face)](./src/patterns/gen-ai/aws-model-deployment-sagemaker/README.md) | Deploy a foundation model from Hugging Face to an Amazon SageMaker endpoint. | Amazon SageMaker | | [SageMaker model deployment (Custom)](./src/patterns/gen-ai/aws-model-deployment-sagemaker/README.md) | Deploy a foundation model from an S3 location to an Amazon SageMaker endpoint. | Amazon SageMaker | | [Amazon Bedrock Monitoring (Amazon CloudWatch Dashboard)](./src/patterns/gen-ai/aws-bedrock-cw-dashboard/README.md) | Amazon CloudWatch dashboard to monitor model usage from Amazon Bedrock. | Amazon CloudWatch | | [Bedrock Data Automation](./src/patterns/gen-ai/aws-bedrock-data-automation/README.md) | Use Amazon bedrock data automation client to to build and manage intelligent document processing, media analysis, and other multimodal data-centric automation solutions | AWS Lambda, Amazon S3 bucket | | [Bedrock Batch Step Functions](./src/patterns/gen-ai/aws-bedrock-batch-stepfn/README.md) | Manage Bedrock model invocation jobs(batch inference) in AWS Step Functions state machines | AWS Step Functions, AWS Lambda, AWS EventBridge, Amazon Bedrock, AWS IAM | ### L2 Constructs > [!WARNING] > Important: Amazon Bedrock L2 constructs are transitioning to the AWS CDK core repository. You can now find these constructs at: https://github.com/aws/aws-cdk/tree/main/packages/%40aws-cdk/aws-bedrock-alpha. > Please migrate to the alpha package, as Bedrock L2 constructs in this repository are now deprecated and will no longer receive updates. | **Construct** |Description| AWS Services used | |:-------------|:-------------|:-------------| | [Amazon Bedrock](./src/cdk-lib/bedrock/README.md) | CDK L2 Constructs for Amazon Bedrock. | Amazon Bedrock, Amazon OpenSearch Serverless, AWS Lambda | | [Amazon OpenSearch Serverless Vector Collection](./src/cdk-lib/opensearchserverless/README.md) | CDK L2 Constructs to create a vector collection. | Amazon OpenSearch Vector Index | | [Amazon OpenSearch Vector Index](./src/cdk-lib/opensearch-vectorindex/README.md) | CDK L1 Custom Resource to create a vector index. | Amazon OpenSearch Serverless, AWS Lambda | | [Amazon Aurora DSQL](./src/cdk-lib/aurora-dsql/README.md) | CDK L2 Constructs for Amazon Aurora DSQL. | Amazon Aurora DSQL | | [Amazon S3 Vectors](./src/cdk-lib/s3vectors/README.md) | CDK L2 Constructs for Amazon S3 vectors. | Amazon S3 Vectors | ## Sample Use Cases The official [samples repository](https://github.com/aws-samples/generative-ai-cdk-constructs-samples) includes a collection of functional use case implementations to demonstrate the usage of AWS Generative AI CDK Constructs. These can be used in the same way as architectural patterns, and can be conceptualized as an additional "higher-level" abstraction of those patterns. Those patterns (constructs) are composed together into [stacks](https://docs.aws.amazon.com/cdk/latest/guide/stacks.html), forming a "CDK app". ## Additional Resources | Resource | Type | Description| |:-------------|:-------------|:-------------| | [AWS re:Invent 2023 - Keynote with Dr. Werner Vogels](https://youtu.be/UTRBVPvzt9w?t=6252) | Keynote | Dr. Werner Vogels, Amazon.com's VP and CTO, announces the AWS Generative AI CDK Constructs during his AWS re:Invent 2023 keynote. | | [Workshop - Building Generative AI Apps on AWS with CDK](https://catalog.workshops.aws/building-genai-apps) | Workshop | In this workshop, you will explore how to build a sample generative AI app on AWS using CDK and Generative AI CDK Constructs. | | [Workshop - Hands on AWS CDK Generative AI Constructs](https://catalog.us-east-1.prod.workshops.aws/workshops/84c00416-19b6-44c3-8d18-cc172361af41/en-US) | Workshop | In this workshop you will deploy projects that use CDK constructs from this library. Projects are from the [amazon-bedrock-samples](https://github.com/aws-samples/amazon-bedrock-samples/tree/main) Github Repository. | | [Build generative AI applications with Amazon Titan Text Premier, Amazon Bedrock, and AWS CDK](https://aws.amazon.com/blogs/machine-learning/build-generative-ai-applications-with-amazon-titan-text-premier-amazon-bedrock-and-aws-cdk/) | Blog post + Code sample | Blog post exploring building and deploying two sample applications powered by Amazon Titan Text Premier using the Generative AI CDK constructs. | | [aws-cdk-stack-builder-tool](https://github.com/aws-samples/aws-cdk-stack-builder-tool) | Code sample | AWS CDK Builder is a browser-based tool designed to streamline bootstrapping of Infrastructure as Code (IaC) projects using the AWS Cloud Development Kit (CDK). | | [CDK Live! Building generative AI applications and architectures leveraging AWS CDK Constructs!](https://www.youtube.com/watch?v=NI1F4Xxqyr8) | Video | CDK Live! episode focused on building and deploying generative AI applications and architectures on AWS using the AWS Cloud Development Kit (CDK) and the AWS Generative AI CDK Constructs. | | [Announcing AWS Generative AI CDK Constructs!](https://aws.amazon.com/blogs/devops/announcing-generative-ai-cdk-constructs/) | Blog post | Blog post announcing the release of the AWS Generative AI CDK Constructs. | | [Streamline insurance underwriting with generative AI using Amazon Bedrock](https://aws.amazon.com/blogs/machine-learning/streamline-insurance-underwriting-with-generative-ai-using-amazon-bedrock-part-1/)| Blog post + Code sample | Blog post and code sample discussing how to use AWS generative artificial intelligence (AI) solutions like Amazon Bedrock to improve the underwriting process, including rule validation, underwriting guidelines adherence, and decision justification. | | [aws-genai-llm-chatbot](https://github.com/aws-samples/aws-genai-llm-chatbot/tree/main) | Code sample | Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS allowing you to experiment with a variety of Large Language Models and Multimodal Language Models, settings and prompts in your own AWS account. | | [bedrock-claude-chat](https://github.com/aws-samples/bedrock-claude-chat) | Code sample | AWS-native chatbot using Bedrock + Claude (+Mistral). | | [amazon-bedrock-rag](https://github.com/aws-samples/amazon-bedrock-rag)| Code sample | Fully managed RAG solution using Knowledge Bases for Amazon Bedrock. | | [Amazon Bedrock Multimodal Search](https://github.com/aws-samples/amazon-bedrock-titan-multimodal-search) | Code sample | Multimodal product search app built using Amazon Titan Multimodal Embeddings model. | | [Amazon Bedrock Knowledge Bases with Private Data](https://blog.serverlessadvocate.com/amazon-bedrock-knowledge-bases-with-private-data-7685d04ef396)| Blog post + Code sample | Blog post and associated code sample demonstrating how to integrate Knowledge Bases into Amazon Bedrock to provide foundational models with contextual data from private data sources. | | [Automating tasks using Amazon Bedrock Agents and AI](https://blog.serverlessadvocate.com/automating-tasks-using-amazon-bedrock-agents-and-ai-4b6fb8856589) | Blog post + Code sample | Blog post and associated code sample demonstrating how to deploy an Amazon Bedrock Agent and a Knowledge Base through a hotel and spa use case. | | [Agents for Amazon Bedrock - Powertools for AWS Lambda (Python)](https://docs.powertools.aws.dev/lambda/python/latest/core/event_handler/bedrock_agents/#using-aws-cloud-developer-kit-cdk) | Code sample | Create Agents for Amazon Bedrock using event handlers and auto generation of OpenAPI schemas. | | [Text to SQL Bedrock Agent](https://github.com/aws-samples/amazon-bedrock-samples/tree/main/agents-for-bedrock/use-case-examples/text-2-sql-agent-cdk-enhanced) | Code sample | Harnessing the power of natural language processing, the "Text to SQL Bedrock Agent" facilitates the automatic transformation of natural language questions into executable SQL queries. | | [Dynamic Text-to-SQL for Enterprise Workloads with Amazon Bedrock Agent](https://github.com/aws-samples/sample-Dynamic-Text-to-SQL-with-Amazon-Bedrock-Agent) | Code sample | Elevate your data analysis with an end-to-end agentic Text-to-SQL solution, built on AWS for enterprise-scale adaptability and resilience. Ideal for complex scenarios like fraud detection in financial services. | ## Contributors [![contributors](https://contrib.rocks/image?repo=awslabs/generative-ai-cdk-constructs&max=2000)](https://github.com/awslabs/generative-ai-cdk-constructs/graphs/contributors) ## Operational Metrics Collection Generative AI CDK Constructs may collect anonymous operational metrics, including: the region a construct is deployed, the name and version of the construct deployed, and related information. We may use the metrics to maintain, provide, develop, and improve the constructs and AWS services. ## Roadmap Roadmap is available through the [GitHub Project](https://github.com/orgs/awslabs/projects/136) ## Deprecation To understand our deprecation process, please refer to the dedicated [documentation](./DEPRECATION_PROCESS.md) ## License Apache-2.0 ## Legal Disclaimer You should consider doing your own independent assessment before using the content in this library for production purposes. This may include (amongst other things) testing, securing, and optimizing the CDK constructs and other content, provided in this library, based on your specific quality control practices and standards. --- &copy; Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.

AI & Machine Learning
537 Github Stars
kubeflow-manifests
Open Source

kubeflow-manifests

[![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen.svg?style=flat)](https://github.com/awslabs/kubeflow-manifests/issues) ![current development version](https://img.shields.io/badge/Kubeflow-v1.7.0-green) [![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](./LICENSE) # Kubeflow on AWS ## Overview Kubeflow on AWS is an open source distribution of [Kubeflow](https://www.kubeflow.org/) that provides its own Kubeflow manifests to support integrations with various AWS managed services. Use Kubeflow on AWS to streamline data science tasks and build highly reliable, secure, and scalable machine learning systems with reduced operational overheads. ## Getting Started There are a number of deployment options for installing Kubeflow with AWS service integrations. To get started with deploying Kubeflow on [Amazon Elastic Kubernetes Service (Amazon EKS)](https://aws.amazon.com/eks/), see the [deployment section](https://awslabs.github.io/kubeflow-manifests/docs/deployment/) on the [Kubeflow on AWS](https://awslabs.github.io/kubeflow-manifests/) website. ## Help & Feedback For help, please consider the following venues (in order): * [Documentation](https://awslabs.github.io/kubeflow-manifests/docs/) * [Search open issues](https://github.com/awslabs/kubeflow-manifests/issues) * [File an issue](https://github.com/awslabs/kubeflow-manifests/issues/new/choose) * Chat with us on the `#platform-aws` channel in the [Kubeflow Slack](https://www.kubeflow.org/docs/about/community/#slack) community. ## Contributing We welcome community contributions and pull requests. See our [contribution guide](CONTRIBUTING.md) for more information on how to report issues, set up a development environment, and submit code. We adhere to the [Amazon Open Source Code of Conduct](CODE_OF_CONDUCT.md#code-of-conduct). ## Security See [CONTRIBUTING](CONTRIBUTING.md#security-issue-notifications) for more information. ## License This project is [licensed](LICENSE) under the Apache-2.0 License.

ML Frameworks Container Management
188 Github Stars
aiops-modules
Open Source

aiops-modules

# AIOps Modules AIOps modules is a collection of reusable Infrastructure as Code (IAC) modules that works with [SeedFarmer CLI](https://github.com/awslabs/seed-farmer). Please see the [DOCS](https://seed-farmer.readthedocs.io/en/latest/) for all things seed-farmer. The modules in this repository are decoupled from each other and can be aggregated together using GitOps (manifest file) principles provided by `seedfarmer` and achieve the desired use cases. It removes the undifferentiated heavy lifting for an end user by providing hardended modules and enables them to focus on building business on top of them. ## General Information The modules in this repository are / must be generic for reuse without affiliation to any one particular project in Machine Learning and Foundation Model Operations domain. All modules in this repository adhere to the module structure defined in the [SeedFarmer Guide](https://seed-farmer.readthedocs.io/en/latest) - [Project Structure](https://seed-farmer.readthedocs.io/en/latest/project_development.html) - [Module Development](https://seed-farmer.readthedocs.io/en/latest/module_development.html) - [Module Manifest Guide](https://seed-farmer.readthedocs.io/en/latest/manifests.html) - [Seed-Farmer Workshop](https://catalog.us-east-1.prod.workshops.aws/workshops/dfd2f6b2-3923-4d79-80bd-7db6c4842122/en-US) ## Deployment See deployment steps in the [Deployment Guide](DEPLOYMENT.md). ## Project Manifests End-to-end example use-cases built using modules in this repository. | Type | Description | |-----------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | [MLOps with Amazon SageMaker](manifests/mlops-sagemaker/) | Set up environment for MLOps with Amazon SageMaker. Deploy secure Amazon SageMaker Studio Domain, and provisions SageMaker Project Templates using Service Catalog, including model training and deployment. | | [Amazon SageMaker HyperPod on Amazon EKS](manifests/hyperpod-eks/) | Deploy Amazon SageMaker HyperPod cluster orchestrated by Amazon EKS with FSx Lustre for high-performance distributed training workloads. | | [Ray on Amazon Elastic Kubernetes Service (EKS)](manifests/ray-on-eks/) | Run Ray on AWS EKS. Deploys an AWS EKS cluster, KubeRay Ray Operator, and a Ray Cluster with autoscaling enabled. | | [Fine-tune 6B LLM (GPT-J) using Ray on Amazon EKS](manifests/fine-tuning-6b/) | Run fine-tuning of 6B GPT-J LLM. Deploys an AWS EKS cluster, KubeRay Ray Operator, and a Ray Cluster with autoscaling enabled, and runs a fine-tuning job. [How to fine tune a 6B LLM simply and cost-effective using Ray on Amazon EKS?](https://medium.com/@junjie-tang/how-to-fine-tune-a-6b-llm-simply-and-cost-effective-using-ray-ai-runtime-on-amazon-eks-a4ae0b3c6464) | | [DeepSeek R1 on Amazon SageMaker](manifests/deepseek-sagemaker/) | An example using [DeepSeek R1 Distill Llama 8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) on Amazon SageMaker. Deploys a VPC, and Amazon SageMaker endpoint and Amazon SageMaker Studio IDE. | | [Deploy a Weather Agent with Strands and Amazon EKS Auto Mode](manifests/eks-strands-agents-demo/) | An example using [Strands](https://strandsagents.com/latest/) agent on [Amazon EKS Auto Mode](https://aws.amazon.com/eks/auto-mode/). | | [Mlflow tracking server and model registry with Amazon SageMaker](manifests/mlflow-tracking/) | An example using Mlflow experiments tracking, model registry, and LLM tracing with Amazon SageMaker. Deploy self-hosted Mlflow tracking server and model registry on AWS Fargate, and Amazon SageMaker Studio Domain environment. | | [Managed Workflows with Apache Airflow (MWAA) for Machine Learning Training](manifests/mwaa-ml-training/) | An example orchestrating ML training jobs with Managed Workflows for Apache Airflow (MWAA). Deploys MWAA and an example ML training DAG. | | [MLOps with Step Functions](manifests/mlops-stepfunctions/) | Automate machine learning lifecycle using Amazon SageMaker and AWS Step Functions. | | [Bedrock Fine-Tuning with Step Functions](manifests/bedrock-finetuning-sfn/) | Continuously Fine-tune a Foundation Model with Bedrock Fine-Tuning jobs and AWS Step Functions. | | [AppSync Knowledge Base Ingestion and Question and Answering RAG](manifests/fmops-qna-rag/) | Creates an Graphql endpoint for ingestion of data and and use ingested as knowledge base for a Question and Answering model using RAG. | ## Modules ### SageMaker Modules | Type | Description | |--------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | [SageMaker Studio Module](modules/sagemaker/sagemaker-studio/README.md) | Provisions secure SageMaker Studio Domain environment, creates example User Profiles for Data Scientist and Lead Data Scientist linked to IAM Roles, and adds lifecycle config | | [SageMaker HyperPod EKS Module](modules/sagemaker/hyperpod-eks-tf/README.md) | Creates a complete Amazon SageMaker HyperPod cluster infrastructure orchestrated by Amazon EKS. Deploys networking components, EKS cluster, HyperPod cluster, and supporting resources including FSx Lustre for high-performance storage. | | [SageMaker Project Templates Factory Module](modules/sagemaker/sagemaker-templates/README.md) | Provisions SageMaker Project Templates for an organization based on the specified template type. Available templates:<br/> - [Train a model on Abalone dataset using XGBoost](modules/sagemaker/sagemaker-templates/README.md#train-a-model-on-abalone-dataset-with-xgboost-template)<br/>- [Perform batch inference](modules/sagemaker/sagemaker-templates/README.md#batch-inference-template)<br/>- [Multi-account model deployment](modules/sagemaker/sagemaker-templates/README.md#multi-account-model-deployment-template) <br/>- [HuggingFace model import template](modules/sagemaker/sagemaker-templates/README.md#huggingface-model-import-template) <br/>- [LLM fine-tuning and evaluation](modules/sagemaker/sagemaker-templates/README.md#llm-evaluate-template) | | [SageMaker Notebook Instance Module](modules/sagemaker/sagemaker-notebook/README.md) | Creates secure SageMaker Notebook Instance for the Data Scientist, clones the source code to the workspace | | [SageMaker Ground Truth Labeling Module](modules/sagemaker/sagemaker-ground-truth-labeling/README.md) | Creates a state machine to allow labeling of images and text file, uploaded to the upload bucket, using various built-in task types in SageMaker Ground Truth. | | [SageMaker Model Monitoring Module](modules/sagemaker/sagemaker-model-monitoring/README.md) | Deploy data quality, model quality, model bias, and model explainability monitoring jobs which run against a SageMaker Endpoint. | | [SageMaker Endpoint Module](modules/sagemaker/sagemaker-endpoint/README.md) | Creates SageMaker real-time inference endpoint for the specified model package or latest approved model from the model package group | | [SageMaker Custom Kernel Module](modules/sagemaker/sagemaker-custom-kernel/README.md) | Builds custom kernel for SageMaker Studio from a Dockerfile | | [SageMaker Model Package Group Module](modules/sagemaker/sagemaker-model-package-group/README.md) | Creates a SageMaker Model Package Group to register and version SageMaker Machine Learning (ML) models and setups an Amazon EventBridge Rule to send model package group state change events to an Amazon EventBridge Bus | | [SageMaker Model Package Promote Pipeline Module](modules/sagemaker/sagemaker-model-package-promote-pipeline/README.md) | Deploy a Pipeline to promote SageMaker Model Packages in a multi-account setup. The pipeline can be triggered through an EventBridge rule in reaction of a SageMaker Model Package Group state event change (Approved/Rejected). Once the pipeline is triggered, it will promote the latest approved model package, if one is found. | | [SageMaker Model CICD Module](modules/sagemaker/sagemaker-model-cicd/README.md) | Creates a comprehensive CICD pipeline using AWS CodePipelines to build and deploy a ML model on SageMaker. | ### Mlflow Modules | Type | Description | |-------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | [Mlflow Image Module](modules/mlflow/mlflow-image/README.md) | Creates Mlflow Tracing Server Docker image and pushes the image to Elastic Container Registry | | [Mlflow on AWS Fargate Module](modules/mlflow/mlflow-fargate/README.md) | Runs Mlflow container on AWS Fargate in a load-balanced Elastic Container Service. Supports Elastic File System and Relational Database Store for metadata persistence, and S3 for artifact store | | [Mlflow AI Gateway Image Module](modules/mlflow/mlflow-ai-gw-image/README.md) | Creates Mlflow AI Gateway Docker image and pushes the image to Elastic Container Registry | ### FMOps/LLMOps Modules | Type | Description | |--------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------| | [SageMaker JumpStart Foundation Model Endpoint Module](modules/fmops/sagemaker-jumpstart-fm-endpoint/README.md) | Creates an endpoint for a SageMaker JumpStart Foundation Model. | | [SageMaker Hugging Face Foundation Model Endpoint Module](modules/fmops/sagemaker-hugging-face-endpoint/README.md) | Creates an endpoint for a SageMaker Hugging Face Foundation Model. | | [Amazon Bedrock Finetuning Module](modules/fmops/bedrock-finetuning/README.md) | Creates a pipeline that automatically triggers Amazon Bedrock Finetuning. | | [AppSync Knowledge Base Ingestion and Question and Answering RAG Module](modules/fmops/qna-rag/README.md) | Creates an Graphql endpoint for ingestion of data and and use ingested as knowledge base for a Question and Answering model using RAG. | ### Agent Modules | Type | Description | |--------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------| | [Strands Agent on Amazon EKS Auto Mode](modules/agents/eks-strands-agents-demo/README.md) | Creates an Amazon EKS Auto Mode cluster and deploys an example Strands Weather Agent. | ### MWAA Modules | Type | Description | |-------------------------------------------------------------------------|------------------------------------------------------------------------------------------| | [Example DAG for MLOps Module](modules/examples/airflow-dags/README.md) | Deploys a Sample DAG in MWAA demonstrating MLOPs and it is using MWAA module from IDF | ### MLOps using Step Functions Module | Type | Description | |-------------------------------------------------------------------------|------------------------------------------------------------------------------------------| | [Example for MLOps using Step Functions](modules/examples/mlops-stepfunctions/README.md) | Deploys a AWS State Machine in AWS Step Functions demonstrating how to implement the MLOPs using AWS Step Functions | ### EKS Modules | Type | Description | |-----------------------------------------------------------|--------------------------------------------------------------| | [Ray Operator Module](modules/eks/ray-operator/README.md) | Provisions a Ray Operator on EKS. | | [Ray Cluster Module](modules/eks/ray-cluster/README.md) | Provisions a Ray Cluster on EKS. Requires a Ray Operator. | | [Ray Orchestrator Module](modules/eks/ray-orchestrator/README.md) | Creates a Step Function to orcehstrate submission of a sample Ray job that fine-tunes [GPT-J 6B parameters Large Language Model](https://huggingface.co/EleutherAI/gpt-j-6b) on [tiny shakespeare](https://huggingface.co/datasets/karpathy/tiny_shakespeare) dataset and performs inference. | | [Ray Image Module](modules/eks/ray-image/README.md) | An example that builds a custom Ray image and pushes to ECR. | ### Example Modules | Type | Description | |-----------------------------------------------------------|-------------------------------------------------------------------------------------| | [Event Bus Module](modules/examples/event-bus/README.md) | Creates an Amazon EventBridge Bus for cross-account events. | | [Personas Module](modules/examples/personas/README.md) | This module is an example that creates various roles required for an AI/ML project. | ### Industry Data Framework (IDF) Modules The modules in this repository are compatible with [Industry Data Framework (IDF) Modules](https://github.com/awslabs/idf-modules) and can be used together within the same deployment. Refer to `examples/manifests` for examples. ### Autonomous Driving Data Framework (ADDF) Modules The modules in this repository are compatible with [Autonomous Driving Data Framework (ADDF) Modules](https://github.com/awslabs/autonomous-driving-data-framework) and can be used together within the same deployment.

AI & Machine Learning Infrastructure as Code
104 Github Stars