mAIstr0

mAIstr0 is a multi-node clustered application that can distribute a workload across all AI LLM servers running on all nodes in the cluster ATM, the cluster finds all available nodes on the network (need to work on security for this), can successfully submit a prompt to a local LLM server and recieve the output It cannot, yet, split the task into several sub-tasks, and submit those sub-tasks to the other nodes on the network for processing It also needs to be able to interrogate the hardware each node is running on, then choosing the most efficient/fastest LLM host server to run on that hardware, and also pick the most suitable/optimal LLM model to run on that hardware, for the required task But so far? Not bad for a few hours and a few bucks worth of CoPilot (you don;t think I'm coding this shit from scratch these days, do you? Sheesh.... I'm not this fast :P) Lol -=A=- .