Overview
This is a repackaged open source software product with optional support from Meetrix.io. Keep costs low with pay-as-you-go pricing, while gaining access to expert assistance as needed.
Code Llama 70B is a collection of pretrained and fine-tuned generative text model with 70 billion parameters. This model is designed for general code synthesis and understanding. Meta recommends using Code Llama - Instruct variants whenever using Code Llama for code generation since Code Llama - Instruct has been fine-tuned to generate helpful and safe answers in natural language.
Codellama Step-by-step Installation Guide: https://meetrix.io/articles/codellama-developer-guide/ For custom projects of your choice with personalized support, contact us on https://meetrix.io/contact-us
Key Features of our AMI:
Ready-to-Deploy: Unlike the raw codellama models, the AMI version facilitates an immediate launch, eliminating intricate setup processes.
API Integration: Integrated with a robust API, it ensures a seamless interface with a myriad of applications, amplifying flexibility.
OpenAI Compatibility: Tailored for projects aligned with the OpenAI, this AMI guarantees compatibility and seamless interaction with the OpenAI ecosystem.
Code Llama caters to software engineers across various sectors such as research, industry, open-source projects, NGOs, and businesses. However, there are numerous additional applications it can assist with. Code Llama aims to encourage the utilization of Llama 2 for developing innovative tools in both research and commercial domains.
Highlights
- Precise and Reliable Code Generation: Tailored for enhanced understanding, this aligns with natural language instructions, ensuring Code Llama delivers precise code generations.
- Advanced API for ARM64: Future-Proof Your AI Operations as the tech world progressively shifts towards the efficiency of ARM64, Code Llama's optimized API keeps you a step ahead. Position your projects at the forefront of this tech revolution, ensuring scalability, compatibility, and performance that meets tomorrow's demands today.
- Pay-as-You-Go Flexibility: Enjoy cost efficiency with a pay-as-you-go pricing model.
Details
Pricing
Instance type | Product cost/hour | EC2 cost/hour | Total/hour |
|---|---|---|---|
g5.12xlarge | $0.104 | $5.672 | $5.776 |
g5.24xlarge | $0.104 | $8.144 | $8.248 |
g5.48xlarge | $0.104 | $16.288 | $16.392 |
Vendor refund policy
We do not currently support refunds, but you can cancel at any time.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Cloudformation template for Codellama deployment
Codellama is capable of generating text, answering questions, generating content, and performing a range of text-related tasks in response to the provided prompts.
CloudFormation Template (CFT)
AWS CloudFormation templates are JSON or YAML-formatted text files that simplify provisioning and management on AWS. The templates describe the service or application architecture you want to deploy, and AWS CloudFormation uses those templates to provision and configure the required services (such as Amazon EC2 instances or Amazon RDS DB instances). The deployed application and associated resources are called a "stack."
Version release notes
First Release
Additional details
Usage instructions
Click the "Continue to Subscribe" button. After subscribing, you will need to accept the terms and conditions. Click on "Accept Terms" to proceed. Please wait for a few minutes while the processing takes place. Once it's completed, click on "Continue to Configuration".
IAM Role is set up and configured with the necessary permissions to assume the role for the Codellama service. The IAM Policy is created and responsible for accessing Route53 and creating Letsencrypt SSL certificates. Apart from that volume permissions also given for changing volume type of instance.
Access the application via a browser at http://
Product will try to setup SSL based on provided domain name, if domain hosted on route53. If the automatic SSL creation unsuccesful then you have to point domain name into server ip, ssh into server and run /root/certificate_generate_standalone.sh. Admin email is also using for generate SSL certificates.
Resources
Vendor resources
Support
Vendor support
Please contact us through aws@meetrix.io . Please allow up to 12 hours for our support team to address your request.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
