Hi Greg, the issue is that I see a lot of people citing articles and research papers they have read. We know academics can also be biased and samples skewed. I guess have you actually experienced it as in actively use something and swear by its efficiency. Also from a sponsorship perspective it'll reduce headcount. Not talking about the future or the opportunities but the efficiencies right now. I did the stanford AI course earlier this year, and we went through all of the medical case studies. At the end of the day it still needed a person to carefully review the AI work. So it comes down to the efficiency side and a productivity tool at best. My wife is an emergency specialist and the director of emergency we often talk about it and she hasn't seen anything AI but then IT in sydney local health is such a mess I wouldn't be surprised. I went through this with smartcity initiatives state government threw hundreds of millions of dollars and everyone swore by smart city and all the technologies at the city level and the benefit it'll bring. The moment funding was gone no council could afford to maintain it and years later the benefit was not there. Same with blockchain.. on and on. On Tue, Jul 30, 2024 at 8:56 PM Dr Greg Low <greg@sqldownunder.com> wrote:
There has been resistance to continuing to train radiologists in the same numbers.
"In a 2023 study, authors reported a 99.1 sensitivity rate for AI on abnormal radiographs in comparison to a 72.3 percent sensitivity for radiologist reports. Autonomous AI also yielded a 6.3 percent higher sensitivity than reporting radiologists for critical abnormal X-rays."
There are many tasks like this that AI systems now routinely outperform humans.
I was impressed with dome new small, limited purpose robots, like a relatively new one that takes blood. It is placed on your arm, and it looks through your arm, and does a 3D analysis of your veins, venal flow, and damage. It then goes directly for the best spot to get blood. Humans just can't do these things. What it does is vastly reduce the skill level required and increase availability of such services.
Regards
Greg
Dr Greg Low SQL Down Under Pty Ltd +61 419201410
------------------------------ *From:* Scott <scott.barnes@gmail.com> *Sent:* Tuesday, July 30, 2024 8:37:40 PM *To:* ozDotNet <ozdotnet@ozdotnet.com> *Cc:* Tom Gao <tom@tomgao.com>; David Connors <david@connors.com>; Dr Greg Low <greg@sqldownunder.com> *Subject:* Re: AI
omfg. i forgot about this list :D
It may replace Business Analyst and partially Architects one day.
I'm currently dealing with a constant battle between Developers and Business Analysts over daily ownership of requirements that address solutioning issues. The circuit breaker has been using the entire Jira tickets for a project, feeding them to AI Crew Agents ( https://github.com/crewAIInc/crewAI), and having them work overnight on creating an end-to-end technical specifications document based on the existing code base (legacy) combined with the proposed user stories. I also use some TOGAF templates to test a concise formatting option. The results are remarkably professional and accurate compared to the human-centric approach used as a baseline comparison. When multiple AI agents share a context and each has a unique role, it opens up different approaches to communication issues or problem-solving in terms of legacy/reverse engineering mixed with future technical solutioning. It still often hallucinates in critical areas of thought, but i'd say it accelerates the work required here by about 60-70% at the very least (much like it does with C++ code in Unreal Engine, it gives you the breadcrumb trail at the very least to go shape towards a direction you need to head but won't make the game for you sort of thing).
Another practical use case at the moment is in the travel industry. Often, the GDS systems have an open text field for additional but pertinent information for accommodations (e.g., key is under a plant, towels need to be washed, etc.), and there is no uniform standard for storing that information (because the travel industry is rarely ever consistent). Using AI, we can feed it a series of specific templates and ask it to match the criteria based on the types of remarks (think of it as a cascade of chaining different types).
I don't think it's currently anywhere near a stage where it's a job replacement thing, but it's definitely getting there and shaping data towards "source of truth" practical usage.
On Tue, Jul 30, 2024 at 7:26 PM Dr Greg Low via ozdotnet < ozdotnet@ozdotnet.com> wrote:
No old friend at Blackburn
Dr Greg Low SQL Down Under Pty Ltd +61 419201410
------------------------------ *From:* Tom Gao <tom@tomgao.com> *Sent:* Tuesday, July 30, 2024 6:54:08 PM *To:* ozDotNet <ozdotnet@ozdotnet.com> *Cc:* David Connors <david@connors.com>; Dr Greg Low < greg@sqldownunder.com> *Subject:* Re: AI
Hi Greg, funny that I was also at my ophthalmologist this morning there's not many around were you around randwick by any chance ? lol
On Tue, Jul 30, 2024 at 6:40 PM Dr Greg Low via ozdotnet < ozdotnet@ozdotnet.com> wrote:
I should add that the reason he raised it was being literally scared about the future. And not just for himself, the future of work is suddenly becoming apparent to him.
Regards
Greg
Dr Greg Low SQL Down Under Pty Ltd +61 419201410
------------------------------ *From:* David Connors via ozdotnet <ozdotnet@ozdotnet.com> *Sent:* Tuesday, July 30, 2024 5:59:37 PM *To:* ozDotNet <ozdotnet@ozdotnet.com> *Cc:* David Connors <david@connors.com> *Subject:* Re: AI
Doesn't surprise me. We recently bought a new house and I was trying to make sense of all of the town plan documents during the settlement period. I just uploaded it all to ChatGPT and asked for an explanation of everything including impacts of easements etc.
I sent the chat to my town planner and he was pretty shocked at how good it was.
It is not going to delete professions but unless you're onboard with it you won't be able to meet the performance expectations of your customers / employers.
On Tue, 30 Jul 2024 at 16:55, Dr Greg Low <greg@sqldownunder.com> wrote:
Was at an eye specialist this morning for a check-up.
When we were finished, he wanted to talk about AI.
He showed me a system they've started using. It combines input from around six separate technical systems that they use, reads all of the patient history, clinical notes, and compares the captured images across all the years I've been to see him.
As he writes his clinical notes in for the day, it wrote a summary of unbelievably high quality. He told me how it was way better than anything he could ever do, particularly the way it reviewed everything from the past and compared it (in detail) to the current.
He was genuinely concerned about what sort of job he's going to have in future.
It's not replacing him yet, but it's completely changed his ability to work at a much higher level.
Regards,
Greg
Dr Greg Low
1300SQLSQL (1300 775 775) office | +61 419201410 mobile
SQL Down Under | Web: https://sqldownunder.com <https://urldefense.proofpoint.com/v2/url?u=https-3A__sqldownunder.com_&d=DwM...> | About Greg: https://about.me/greg.low <https://urldefense.proofpoint.com/v2/url?u=https-3A__about.me_greg.low&d=DwM...>
*From:* David Connors via ozdotnet <ozdotnet@ozdotnet.com> *Sent:* Tuesday, July 30, 2024 2:17 PM *To:* ozDotNet <ozdotnet@ozdotnet.com> *Cc:* David Connors <david@connors.com> *Subject:* Re: AI
On Sun, 28 Jul 2024 at 23:16, Tom Gao via ozdotnet <ozdotnet@ozdotnet.com> wrote:
I wanted to get some feedback from you guys last time michael said maybe about 1-2% in improvement in usefulness to a seasoned dev. I've had ongoing robust conversations. Because I feel the benefits are completely overstated in general (open to being corrected).
I don't think the benefit is overrated and we see huge value in the use of AI across all of the dev work we do. I think you're possibly looking at it glass half empty instead of glass half full. The question is not whether the AI is smarter than you, can write better code than you - the question is whether you get a great productivity boost in day to day activities.
Co-pilot smashes boring drudge work like making constructors out of the park. You can use ChatGPT to break the back of time consuming but easy work - for example, upload a CSV and then ask it to write you the DDL for a table to store that and a stored procedure to do CRUD operations etc. It churns it out instantly.
If you asked me to write an UPSERT statement in T-SQL or create a user in MySQL I would have to Google it. They're tasks that are easy, but also tasks that I seldom do so don't have the syntax front of mind. I can just leave out the middle-man and get the AI to do it for me.
The most senior tech lead in my team believe it's a negative benefit. As in it can't understand complex business analyst requirements, nor debug codes, nor find / correct defects.
All of our PRs are reviewed by AI before humans touch them (via Code Rabbit). People reviewing PRs are generally more senior, more expensive and time poor. Code Rabbit produces *really* good summaries of what is in the PR and the implications. It provides a lot of low level commentary that is useful to the dev's themselves before asking for a review. You can talk back and forth with Code Rabbit in the comments under the PR in GitHub and ask for suggestions etc.
The effort to prompt engineer and also to correct what's generated is also understated.
What sort of things are you asking it to do? If you're trying to get an LLM to write conceptually complex things then that might be where you have friction.
Here's an example of a CodeRabbit review for a simple change done today in one of our systems together with example of dev conversation. The reviews of complex changes (I could not find a good example without internal information) are astonishingly good and the back and forth with the bot can be very nuanced (arguing the point on why there isn't actually a race condition in some code because it isn't considering this or that). This level of review / suggestion / fix cycle happens before a senior considers the PR.
The poems are a nice touch :)
Conversation on that change with CodeRabbit:
-- ozdotnet mailing list To manage your subscription, access archives: https://codify.mailman3.com/
-- ozdotnet mailing list To manage your subscription, access archives: https://codify.mailman3.com/
