This blog is about Note Web, technology that powers NoteInWeb.com, about Java, JavaScript, Cloud Architectures and Data Science and how these can benefit NoteInWeb.com customers.
Denys Havrylov: Opinions expressed on this site are my own and do not reflect such of people and entities from my past and present project and customer engagements (outside of Note In Web, Inc. business).
It should be easy to start and stop desktop session. Desktop should be nice, modern and sleek. Installing new tools should be quick and reliable. It should be easy to manage hundreds of concurrent sessions in AWS.
For many reasons, enough for a separate large article, shortlisted Xfce for resource efficiency. Modern looks category favorite is KDE Plasma. Briefly checked for suitability for the use case also were:
Let's see if Note Web CAIP Agent can assist lowering entry level for a few AWS and Azure services, somehow differently than AWS Q and Copilot do it.
Denys Havrylov | November 1, 2024 11:05AM CEST |
Llama-3.1-Nemotron-70B ranks among top on Arena Hard and Alpaca Eval as of October 1, 2024. Sharded model files are approximately 150GB. That lines up to VRAM requirements of couple of 80GB A100. AirLLM runs inference layer-wise, enabling 70B LLama3 on 4GB GPU, 405B on 8GB. However, it is yet not a solution for NoteInWeb.com to offer free tokens alternative to 3rd party LLM providers for inference. It takes a few minutes for a single prompt on g4dn.xlarge...
Denys Havrylov | October 28, 2024 9:05PM CEST |
Note In Web, Inc. continuously broadens Note Web support for deploying NW DSL code to Azure with Terraform. As this post mentions, there will be soon a How-to screen cast on this topic. There is a small backlog of implemented stories and relevant hands-on experience.
Typical tasks considered were adding gRPC client to Scala codebase, building gRPC Java server, generating structured text (eg. scripts), launching and controlling OS processes. There are few words about mileage with Aider architect mode, Cline, SWE-Agent, OpenHands, Amazon Q Developer. Plan is to check Agentless and GitHub as well. Drop an email if you find the topic interesting or got ideas for other interesting Java/Python/TypeScript development cases.
Denys Havrylov | October 28, 2024 9:45PM CEST |
Watch this screencast for a quick walkthrough on how to use Note Web DSL to setup an operational site (actually NoteInWeb.com itself) of the following major elements:
This corresponds to legacy Note Web deployment configuration, that relies only on the mentioned AWS services to maintain focus of this screen cast.
Stay tuned for a How-to on using NoteInWeb.com to build an AMI and deploy an auto-scaling group with template based on that AMI. That would conclude the coverage of migrating NoteInWeb.com to AWS (except for finer details, like configuring SSL certificate from ACM, DNS setup with Route53, secrets in AWS Secrets Manager, observability setup and deployment automation - for yet a bit later)
Denys Havrylov | October 19, 2024 9:00PM CEST |
As of Note Web version 11.25, NW CAIP Agent is built to reliably identify prompts addressed to it in a multi-party conversation. NW CAIP Agent in video-chat calls, with or without avatar, i.e. audio-only experience, expects keywords to demarcate the prompt, eg. "Note Web, please..." and "Go, Avatar!"
Needless to mention the risks of forgetting the "Open Sesame" keywords, this approach may not seem quite natural in peer-to-peer human-AI conversations.
So, Note in Web, Inc. product management has been seeking to offer a still reliable, but way more streamlined experience for peer-to-peer calls without avatar video feed. Its when OpenAI Realtime API (beta) offers an interesting opportunity.
Note Web development works toward enabling this flow (one of Note Web versions following 11.41):
Don't worry about interrupting NW CAIP Agent responses, when needed. Properly identifying request type and extracting function call parameters is way more challenging, than in keywords-based approach, but benefits seem worth the effort.
Drop an email to Note in Web, Inc. if you already have a case for Note Web CAIP Agent streamlined audio experience or would like to find out more!
Denys Havrylov | October 5, 2024 9:00PM CEST |
How long will it take you to migrate IaC code for AWS EKS cluster with EFS volumes for 12 services (by Ansible) to Azure Kubernetes Services with Azure Files (by Terraform)?
Stay tuned... Details will follow soon.
In the meantime, let's wonder how many errors are to expect on initial "terraform plan; terraform apply" of so migrated code, be it handwritten or emitted by some LLM.
Denys Havrylov | September 15, 2024 9:05PM CEST |
Any code that NoteInWeb.com generates for your account is your property. It is a non-binding solution suggestion for Note Web DSL blueprint you or Note Web CAIP Agent on your behalf, in chat or through its avatar supply as input.
If you're curious about examples of Note Web PaaS DSL Service generated code, check out https://github.com/denyshavrylov/noteweb-dsl-code-portfolio
This repository purpose is to back each screencast on Note Web channel. There are only a few samples now, but screencast-examples coverage is growing. Also, newer versions of Note Web PaaS DSL Service generate cleaner code, so corresponding branches of this github.com repo are being updated accordingly.
Denys Havrylov | September 5, 2024 9:00PM CEST |
Can you guess how many lines of Note Web DSL code are needed to define 12 Kubernetes services with persistent volumes, config maps, and secrets? And can you guess which IaC technology Note In Web, Inc. will use to deploy its SaaS to AWS?
Denys Havrylov | August 31, 2024 9:00PM CEST |
Denys Havrylov | August 19, 2024 9:40PM CEST |
Denys Havrylov | July 31, 2024 9:00PM CEST |
Denys Havrylov | July 8, 2024 0:05AM CEST |
Denys Havrylov | June 29, 2024 9:00PM CEST |
Denys Havrylov | June 18, 2024 8:50PM CEST |
You know, that Problem-Domain-Solution web notes can turn to a Note Web DSL blueprint and then generate code, deploy and run in AWS, just with a couple of commands.
Denys Havrylov | June 9, 2024 9:00PM CET |
Denys Havrylov | May 21, 2024 0:40AM CET |
Delivery pipeline for May 2024 is fully packed on one side. On the other, April and May 2024 are very busy in my other professional ventures. So development capacity for Note Web is yet scarcer than it was before. Still, I work towards providing a Note Web How-to screen-cast that would answer the title question later in 2024 (originally June 2024, then summer 2024, then 2024Q3 - even recent coding LLM advances don't make up for lack of funds in product roadmap, since alluded feature should be reliably accessible to all NoteInWeb.com users to appear in a Note Web How-to screen cast).
Denys Havrylov | May 15, 2024 9:00PM CET |
Denys Havrylov | April 29, 2024 9:00PM CET |
Denys Havrylov | April 2, 2024 9:04PM CET |
Denys Havrylov | March 29, 2024 9:05AM CET |
Development teams can use Note Web to generate boilerplate CRUD code (in Java/Python/TypeScript/Ansible) per standards they define. They can also package their unique expertise as higher order patterns, to be automatically promoted by GPT in its implementation suggestions.
As you can see, the Note Web approach is quite different to that of DevIn or AutoDev. Its goal is not ambitious, just deliver prompt answers and cloud solution suggestions in the virtual context you are in (call, chat, apps), based on your Note Web content and potential of your AWS account.
Denys Havrylov | March 22, 2024 9:05PM CET |
I really look forward to delivering the Note Web CAIP Agent Avatar customization pack to implement "Early Bird Access" reward. Check out other great rewards on the same page!
Denys Havrylov | March 21, 2024 5:45PM CET |
Note In Web, Inc. has demoed key elements of its vision presented in Summer 2022 promo and founder reels, submitted to cohort selection rounds of several accelerators and programs. The focus is now on hardening the infrastructure, codebase, completing its migration to AWS, accommodating growing user base and preparing for marketing campaigns.
There are several features mentioned in this blog's posts as "soon" or "en route", implying they're on Note Web's roadmap, but not yet available on NoteInWeb.com. Generating Infrastructure-as-Code for Azure and backends in .NET are such examples. If you would like to see any such features on NoteInWeb.com rather sooner, than later, pledge for this project on KickStarter.com!
Screenshot of project page on KickStarter.
Denys Havrylov | March 9, 2024 9:05PM CET |
LangChain provides a convenient framework for integrating LLM and Retriever to produce Retrieval-Augmented-Generation. It also automates merging user prompt, problem setting and data retrieved from vector database, that matches combined prompt. There are frameworks and approaches to achieve the same, possibly reducing number of LLM invocations.
DSPy leaves it to developers to decompose their LLM task into modules, define module signatures, come up with at least a dozen of examples for trainings and define metrics to use for optimizing each module. DSPy stands for Declarative Self-improving Language Programs(in python). Note Web CAIP Agent might benefit from DSPy as number of supported AWS/Azure services and higher level patterns grows. Automated prompt tuning would help to turn adding such support for new AWS/Azure services and higher level patterns into largely automated routine.
Denys Havrylov | February 25, 2024 4:09PM CET |
As you can see in previous "How-to" screencasts, Note Web CAIP Agent handles fine demo cases in chat room and voice call scenarios.
128K input tokens of GPT-4 is quite a bulk of text, but the 4096 tokens output is often not enough to document a simple case of CRUD cloud solution for a few entities. However, a group of specialists can discuss so many details in an hour, usually pivoting around a slide deck or wiki page or a few of each, that relevant summary just won't fit 4k tokens even nearly. Needless to mention that RAG can pull in pages of data to augment LLM input yet further.
Note Web CAIP Agent currently can assist you in Amazon Chime chat rooms and voice calls, by summarizing conversation to Problem-Domain-Solution web notes, generating Note Web DSL code from plain text requirements, formulating responses to prompts based on Note Web knowledge models sourcing from files, etc. It can also deploy your Note Web DSL code to your AWS account, straight from chat room or a call. What if you want more control over how your IP is processed?
Stay tuned to see how NoteInWeb.com employs an open source LLM together with Streaming-LLM to put distilling requirements to Note Web DSL code in your full control (your AWS account). Obviously, control over attention sinks won't increase the LLM's context window. But NoteInWeb.com aims to deliver comparable results. Probably after some interleaving with more development on Note Web PaaS DSL stream...
Denys Havrylov | February 9, 2024 9:40PM CET |
That's another exciting work in progress item, that I just could not hold to myself until a proper feature release (and a corresponding How-to screencast) reach public domain.
Note In Web, Inc.'s development prioritizes hardening actual NW DSL handling to detect naming clashes, resources validation and other issues early, before you hit the deploy button. However, there are plenty of possibilities for how deploy can go wrong for reasons outside of Note Web control. After all, its user's AWS account, credentials, policies and existing infrastructure that Note Web PaaS DSL Service deploys against. You do get the deployment scripts and can play with them however you like. Nevertheless, what if you just need to get your cloud solution to work? While self-healing Note Web deployments still require a lot of research work, NoteInWeb.com would soon offer suggestions for remediation in failing NW DSL code, based on deployment log.
Denys Havrylov | January 19, 2024 11:04PM CET |
As mentioned in few 2023 blog posts, Note Web PaaS DSL Service roadmap includes growing support for the most popular backend development languages and technologies (most noticeable long-term honey pots, in a good sense, being .NET/Azure)
However, speaking of now and considering most established stacks in AWS, there is an obvious gap in NW PaaS DSL Service coverage - TypeScript/NodeJS. So this small article was updated to point to another Note Web "How-to" screencast just about that. It shows how to include a TypeScript/NodeJS CRUD microservice into your AWS cloud solution.
Denys Havrylov | January 5, 2024 8:45PM CET |
Start mapping your data and load your public domain cloud solution requirements at NoteInWeb.com!
What for? Well, previous posts in this blog showed that with a few clicks you can turn your plain text requirements into a running CRUD cloud solution implementation suggestion in your AWS account! (Obviously only for supported AWS services - feature - language combinations)
Better yet, the most recent post is about using NoteInWeb.com straight from Amazon Chime chat root (via a chatbot).
However, what if you'd like audible responses and don't feel like typing your questions? Just invite Note Web CAIP Agent Avatar to join your call (as shown in this How-to for Amazon Chime SDK demo app).
Denys Havrylov | December 31, 2023 11:05AM CET |
Denys Havrylov | December 29, 2023 9:00PM CET |
Looking at AI blogs and videos, seems anybody can do Retrieval Augmented Generation with LLMs nowadays. How about creating Problem-Domain-Solution web note straight from your AWS Chime chat room?
This screencast would walk you through the steps required to setup AWS Chime Enterprise account with Okta authentication, register NW CAIP Agent chat bot and use it from your AWS Chime chat rooms.
Stay tuned for a subsequent How-to on actually using the so setup Note Web CAIP Agent to work with cloud solution requirements and runnable implementation suggestions!
... just copy paste the most recent (and relevant, if you prefer) chat room messages to get those summarized as cloud solution requirements. Mention the text to Note Web CAIP Agent chat bot. Voila!
Review the requirements summary in AWS Chime Application UI in chat bot's response or jump back to NoteInWeb.com to access the just generated Problem-Domain-Solution web note! You're all set to generate NW DSL code deployable as Java/Python/Typescript/Ansible source and/or packages/containers!
Deploying from AWS Chime chat room is also possible, just mention it to NW CAIP chat bot.
Denys Havrylov | December 24, 2023 9:50PM CET |
Denys Havrylov | December 4, 2023 9:00PM CET |
NoteInWeb.com empowers you by suggesting a decomposition of your requirements into CRUD microservices with front-ends and storage, generating source code for suggested microservices, storing it in your Git repositories along with deployment Ansible scripts, building, containerizing and deploying them to your Cloud Account.
It is up to you to register for the following services and supply corresponding API keys in your NoteInWeb.com tags:
Until Note In Web, Inc.'s technical operations become SOC2 certified, recommendation stands to generate and dispose of API keys on case-by-case basis. This screencast explains just that. How to generate API keys in these services, how to setup Problem-Domain-Solution and NW Context tags with API keys in NoteInWeb.com UI and how to dispose of API keys, once you don't need further deployable/runnable code suggestions for the current case. This way you don't need to concern yourself about somebody gaining access to your cloud, LLM or VDB account through your NoteInWeb.com account.
Denys Havrylov | November 29, 2023 9:40PM CET |
Of course, CloudFront brings content closer to users. That matters for Single Page Applications, that Note Web generates out of NW DSL code as well.
However, what if you're still early in development cycle? Manual changes in infrastructure or frontend code can introduce errors. Having another processing layer in CDN, can complicate tracing such issues. Ever wondered, what's use of keeping the long track of each time your CloudFront distribution cache got dumped? There are better things to think about...
Don't use CDN if you don't need it. Drop "cdn" statement in your NW DSL code and Note Web would do proper wiring, including setting CORS policies on API gateway and setting proper access policy for making your S3 bucket public. So that you could access your SPA directly from your S3 bucket sourced from the just deployed AWS API Gateway protected by AWS Cognito user pool authenticator.
Denys Havrylov | November 12, 2023 9:00PM CET |
Focus of NoteInWeb.com is on personal content management and broader, improved utilization of your public cloud accounts, possibly before you fully onboard all of the needed cloud development expertise. That's why we let you bring your own LLM* and VDB** accounts to generate non-binding Note Web DSL code suggestions and deploy those to your AWS account. Assuming no responsibility for the accuracy of the suggestion, NoteInWeb.com exposes what kind of tech and code could achieve your requirements, while letting you gradually refine the requirements themselves and generated Note Web DSL code. NoteInWeb.com also keeps you in charge of your LLM, VDB and cloud infrastructure costs. There are no hidden premiums each time you generate Java/Python/TypeScript/Ansible for your micro-services and infrastructure. Part of the puzzle is to make understanding generated code easy for the broadest possible developer audience, that's why the guideline of using SDK-level constructs and only well known and proven Open Source libraries.
This separation of concerns might change as company grows in terms of funding, retained user base or revenue. radapp.io and dapr.io tech stacks bring a great selection of higher level patterns, some of which have been mentioned in previous NoteInWeb.com blog posts. However, they come with some learning curve, at minimum:
So, NoteInWeb.com can simplify further the leap to using radapp.io/dapr.io tech stacks at some point by making a "cloud"-statement level deployer type "Radius" (next to the currently default "Ansible"). That would also define the code generation of nested micro-services.
Current planning is to approach the matter of higher-level application patterns, possibly via radapp.io and dapr.io tech stack after:
* - Large Language Model
** - Vector Databases are used to build RAG - Retrieval Augmented Generation, by storing and querying embeddings calculated for indexed data by LLM
Denys Havrylov | October 19, 2023 9:40PM CET |
What's use of defining your own microservices for Create-Read-Update-Delete applications on multiple entities, if you can't control who can see or change your data? At last this concern, no longer applies to Note Web DSL, as Note Web v.9.40 DSL supports "auth":
Denys Havrylov | October 4, 2023 9:05PM CET |
What if you don't know yet, if you want your cloud solution to run on AWS EKS cluster backed by Fargate or EC2 nodes? What if you just don't care now, if your data is stored in MySQL or Postgres? But you do know how your data, your forms look like. Then NoteInWeb.com can help! Formulate your requirements as plain text, put in your OpenAI API key (don't forget to remove once done!) and take a look at LLM's suggested Note Web DSL code!
So far, NoteInWeb, Inc. has shown how to generate AWS ECS containers, AWS Lambdas in Python or Java. You're more used to Kubernetes? You've got it! Take a look at this screencast of defining a simple Spring Boot 3.1 Java 17 REST API microservice and deploying that to a just baked AWS EKS cluster.
Denys Havrylov | September 29, 2023 8:55PM CET |
The previously announced screencast of Note Web DSL code yielding Kubernetes microservices behind Cognito-authenticated AWS API Gateway is in final release stages. This article is a yet another announcement: Note Web DSL generation comes to an online meetings service!
Denys Havrylov | September 25, 2023 9:50PM CET |
This screencast shows ChatGPT generating cloud architecture problem description. Then Note Web CAIP Agent steers LLM to generate Note Web DSL code that resolves the previously generated problem. As previous screencasts showed, such Note Web DSL code is deployable to user's AWS account and source code git repositories.
Denys Havrylov | August 31, 2023 9:40PM CET |
Summer 2023 is almost over. Let's summarize the new Note Web features in a few lines of Note Web DSL code, but such produced by LLM in response to its own requirements!
Denys Havrylov | August 29, 2023 6:49PM CET |
This video focuses on code of generated Python microservice, its configuration for DynamoDB tables and OpenSearch cluster, as well as support for logging, metrics and tracing with X-Ray. AWS OpenSearch cluster used in the demo, was setup by Note Web DSL as well. Actual deployment of AWS OpenSearch cluster is in scope for one of the next videos, to cover setup of authentication for accessing OpenSearch Dashboards, logs shipping from Note Web DSL generated CRUD microservices.
Denys Havrylov | August 15, 2023 04:45PM CET |
If you search on youtube.com for "dsl generates backend and frontend", the top non-ad video would be by NoteInWeb, Inc. of Note Web DSL June 2023 premier. From previous blog posts you`d know that some dozens of Note Web DSL code can yield you a working cloud solution running in AWS in less that half an hour
Having to learn a new UI (however slick new NW React Client might be) or new Note Web DSL, should not bother you. Just click on the previous link to see how "requirements generate dsl"!
Denys Havrylov | July 23, 2023 09:00PM CET |
Bring your user stories or otherwise formatted requirements for an AWS cloud solution with a frontend and backend, paste into NoteInWeb.com and get a deployable suggestion Note Web PaaS DSL code!
Create or link to a web note an existing Git repository, reference it in generated Note Web DSL, deploy to your AWS account, and you'll get generated Ansible, TypeScript and Java Spring code sources! ... as well as provisioned AWS resources and running cloud solution ready for use.
Denys Havrylov | July 11, 2023 9:05PM CET |
Denys Havrylov | June 29, 2023 11:50PM CET |
Denys Havrylov | June 19, 2023 11:09PM CET |
Develop an Angular 15 application with a grid-details form backed by an AWS API Gateway, Lambda and RDS in some 18 lines of code.
Denys Havrylov | March 5, 2023 9:00PM CET |
This article is a brief summary of a few GTC Fall 2022 sessions I attended, seeking news about transfer learning, federated learning, latest advances GPU enabled model training and inference, when it becomes available through the cloud, as well as innovative UX development from Metaverse/Omniverse perspective.
Denys Havrylov | September 25, 2022 4:09PM CEST |
Capture product development call notes and other content in your NoteInWeb.com account and see what implementation suggestions NoteInWeb.com has to offer, once you're done!
Denys Havrylov | August 27, 2022 9:05PM CEST |
Take a Note Web PaaS DSL blueprint that generated Java Spring JPA/REST microservice with an embedded database, and connect it to a persistent AWS RDS MySQL instance fully defined in the same blueprint. Give the new microservice a user friendly DNS name under paas.noteinweb.com .
Denys Havrylov | July 31, 2022 1:15PM CEST |
Define a simple Note Web PaaS DSL blueprint and get a microservice defined therein to store data and respond to requests from Internet all within 15 minutes.
Denys Havrylov | June 19, 2022 9:40AM CEST |
Turn your solution requirements notes to blueprints and deploy to AWS - description of approach and technologies used.
Denys Havrylov | May 15, 2022 9:15PM CEST |
Finetuning a GPT-J-6B model with content linked to a web note streamlined, supported by Note Web
Denys Havrylov | October 5, 2021 8:25PM EET |
Example architecture for implementing event metrics with Apache Kafka and Spark in Note Web
Denys Havrylov | September 18, 2021 8:15PM EET |
Industry Best Practices for Cloud WOrkloads - Highlights from publicly available AWS CSA Pro blueprint materials
Denys Havrylov | September 1, 2021 11:19PM EET |
A few notes around Tensorflow 2 MNIST tutorial code.
Denys Havrylov | August 3, 2021 9:40PM EET |
This is a few liner about automated model parameter optimization in Spark Scala.
Denys Havrylov | August 2, 2021 8:40PM EET |
This is a quick note about general expectation towards Data Scientists to be able to explain the nuts and bolts of chosen model algorithm and parameters, analyze the internals of trained model with a sample for a decision tree.
Denys Havrylov | July 25, 2021 11:15PM EET |
This article is about determining time series statistical correlation characteristics for stock market trading using Apache Spark and Apache Druid.
Denys Havrylov | April 29, 2021 12:15PM EET |