Playing with Llama 7B and 13B, I found that the 13B model was capable of doing a simple task, rewriting titles in sentence case for Tildes submissions. The 7B model doesn't appear capable of the same task, out of the box.

I heard about Android's new AICore available on a couple of new devices. But it sounds like Gemini Nano, which runs on-device, can only handle 2B or 3B parameters.

Is this size of model useful for real tasks? Does it only become useful after training on a specific domain? I'm a novice and wanting to learn a little bit about it. On-device AI is an appealing concept to me.

For my job I need to copy a person's name out of a field and split it into first and last names. I have a AHK script that can do this but my version only works with simple, one-word, non-hyphenated names. I tried prompting Gemini as below.

There is a line of text consisting of one or more words, a comma, then one or more words. write an autohotkey 1.1 script to select everything before the comma, store it to a variable called firstname, then select everything after the comma and store it to a variable called lastname. thanks

(the firstname and lastname variables should be swapped as the last name would come before the comma, that was my error)

Here's the AutoHotkey 1.1 script to achieve what you described:

; This script splits a text line into first and last name based on a comma

#NoEnv  ; Recommended for performance and compatibility.
SendMode Input  ; Simulates keystrokes for reliable input.

; Function to split the text
Func SplitText(_text, firstName, lastName) {
  StringSplit, parts, _text, `,`
  if (parts[1]) {
    firstName := parts[1] ; Assign first name
    lastName := SubStr(_text, 1 + StrLen(parts[1])+1) ; Extract last name after comma (including space)
  } else {
    firstName := _text ; Handle cases without a comma
    lastName := ""
  }
}

; Hotkey to trigger the script (replace F2 with your desired key)
F2::
  Send, ^c ; Copy the selected text to clipboard
  clipText := ClipboardAll  ; Read the clipboard content
  SplitText(clipText, firstName, lastName) ; Call the function to split the text
  MsgBox, First Name: %firstName%`nLast Name: %lastName%

  ; Optional: Clear clipboard to avoid unintended pasting (comment out if not desired)
  ; Clipboard := 
Return

Explanation:

#NoEnv and SendMode Input: These lines are included for performance and reliable input simulation.
Func SplitText(_text, firstName, lastName): This function takes the text (_text) as input and assigns the split parts to variables firstName and lastName.
StringSplit, parts, _text, ,:** Splits the text based on the comma (,`) delimiter.
if (parts[1]):** Checks if there's a second part (i.e., text after the comma).
If true, the first part is assigned to firstName and the text after the comma (including the space) is extracted using SubStr and assigned to lastName.
else:** If there's no comma, the entire text is assigned to firstName and lastName is set to an empty string.
F2::: This line defines a hotkey. When F2 is pressed, the following actions occur:
Send, ^c:** Copies the selected text to the clipboard.
clipText := ClipboardAll:** Reads the copied text from the clipboard and stores it in the variable clipText.
SplitText(clipText, firstName, lastName):** Calls the function to split the copied text into first and last names.
MsgBox:** Displays a message box showing the extracted first name and last name.
Optional: Clear Clipboard: The commented line Clipboard := clears the clipboard content after processing. Uncomment this line if you want to avoid accidentally pasting the copied text elsewhere.

Edit: To answer questions, and provide info I probably should have from the beginning: I'm a medical transcriptionist using AHK with my job's software (Emdat Inscribe) and a word expander (Instant Text). Inscribe seems to be browser-based but functions as a standalone app. I already have dozens of AHK 1.1 macros; my .ahk file has over 2000 lines, although I'm sure it's terribly written code. This is also why I'm disinclined to switch to AHK 2.0 since I have no desire to rewrite everything unless absolutely necessary. The first part of this macro is a bunch of keypresses to jump to the relevant patient info field, then this part would be used to store the names appropriately. I already have hotkeys to use the variables as needed and most macros are limited with #ifwinactive to Inscribe.

I am and have been on a bit of a quest to make my computing devices suck less.

Over the last few years I have migrated all of my laptops and desktops over to various Linux flavors. My experience with this process is that each flavor has their own quirks that need to be ironed out, but after getting things running there is little in the way of maintenance. Things kind of just work nowadays.

I have been looking into getting something like (but not necessarily) LineageOS on my phone. As I am looking into this and reading forums on the subject, it seems like a perpetual arms race between application developers and application users. One puts in a way to check for root, then there are root hiders, then there are root hider checkers, then there are root hiders that you build with custom names, etc.

I want my device to not suck.

I don’t want to be going in and fighting with my banking applications every time there is an update. I am totally willing to fight a painful setup once.

Is a custom phone OS something that is essentially only viable to use if you are driven by spite? Am I reading too much into the struggles that are posted in various forums? I am looking for any input for anyone that has used a custom OS short or long term.