Jump to content

Recommended Posts

  • 2 months later...
  • Replies 126
  • Created
  • Last Reply

Top Posters In This Topic

Posted

 

I like this definition:

 

"A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E."

 

 

 

Posted

I haven't read it, but this book looks like it might be good on the subject of AI and is for sale today at AMZN

 

https://www.amazon.com/Life-3-0-Being-Artificial-Intelligence-ebook/dp/B06WGNPM7V?_bbid=12998103&tag=ebookdealspagesite-20

 

Thanks. Bought it.

 

I did too, started reading it this morning. I have seen Max Tegmark on shows about cosmology, math, etc.

 

Yeah, I've heard some of his stuff.

 

I also get his "Future of Life Institute" emails that discuss AI future/ethics/etc. (They also touch topics like autonomous weapons and nuclear weapons that belong more to Politics section).

  • 2 weeks later...
Posted

 

Interesting fact: I think most of Boston Dynamic robots are trained with a model-based system (i.e. this is how the world works and therefore do this) and not deep learning which is interesting.  See here: https://www.alexirpan.com/2018/02/14/rl-hard.html

 

  • 2 weeks later...
  • 2 weeks later...
  • 1 month later...
  • 1 month later...
Posted

For a change something investing related:

 

a16z thinks that AI startups are worse than SaaS startups:

https://a16z.com/2020/02/16/the-new-business-of-ai-and-how-its-different-from-traditional-software/

 

There's also a TechCrunch article that's a follow-up: "Do AI startups have worse economics than SaaS shops?"

However, it's behind their premium paywall. If anyone can get a full article, shoot me a message. I'm interested.

 

(OT: I searched for the article using the title. OMFG, there's like huge industry of sites that just copy shit from TC and post it on their sites. I did not realize this was a thing.)

Posted

Yeah, it seems pretty clear to me that AI companies have worse economics that SaaS, but SaaS have better economics than any other business.  That said, I think there's a chance that an AI company evolves that has a stronger moat and better economics than any SaaS business, but I'd expect the average SaaS business to have way better economics than the average AI business.

  • 6 months later...
Posted

Reviving this thread. This is unfortunate use of algorithms/machine learning/AI.

 

When Algorithms Give Real Students Imaginary Grades

https://www.nytimes.com/2020/09/08/opinion/international-baccalaureate-algorithm-grades.html

Thanks for sharing.

 

Hard to tell if this was an issue of taking algo out of lab and going against live data vs. truly shoddy data science work. This is a truly hard problem with so many variables and technological complexities (e.g., some of the tests are free form) so I'm leaning on the latter. I'm skeptical that they had the time to really do the proper evaluation. Without IB releasing info, I doubt anyone will successfully reverse engineer their algo. But, it would be nice if all IB participants banded together and provided their scores to do some bias analysis.

Posted

Reviving this thread. This is unfortunate use of algorithms/machine learning/AI.

 

When Algorithms Give Real Students Imaginary Grades

https://www.nytimes.com/2020/09/08/opinion/international-baccalaureate-algorithm-grades.html

 

I'm not gonna defend the results.

 

However, what in your (and author's) opinion should have been done? The simple answer is not having exams at all. Would that have worked better for poor kids? Colleges would have been forced to use the same (or similar) info for their admissions that the computer used for exam: "an array of student information, including teacher-estimated grades and past performance by students in each school".

 

There is also a conclusion by author: "Algorithms should not be used to assign student grades."

This is bullcrap. First of all, they already are with pretty much zero opposition: https://www.ets.org/gre/revised_general/scores/how/ (yeah, human is in the loop, but still)

Second, the answer is to improve algorithms rather than discard them.

 

Author also is wrong on a number of other counts: they don't agree with "Computers make neutral decisions" - yeah, computers can have bias, but human graders definitely have bias - and are susceptible to fatigue, misunderstandings, and even fraud. I'd guess that's one of the reasons why ETS uses algorithmic scorer in addition to human one.

 

Author tries to score a lot of points with claims: "Algorithms can’t monitor or detect hate speech, ... they can’t predict crime, they can’t determine which job applicants are more suited than others, they can’t do effective facial recognition" - except that algorithms can do all of these and they do all of these and they are getting better in doing all of these. Yeah, you can prohibit using AI for facial recognition by law, but it does not mean that algorithms are or won't be better in recognizing people than people are.

 

Anyway, it sucks to be caught in this, but the way to go is to improve algorithms rather than giving up and going back to warm and fuzzy human-graded default.

Posted

Reviving this thread. This is unfortunate use of algorithms/machine learning/AI.

 

When Algorithms Give Real Students Imaginary Grades

https://www.nytimes.com/2020/09/08/opinion/international-baccalaureate-algorithm-grades.html

 

I'm not gonna defend the results.

 

However, what in your (and author's) opinion should have been done? The simple answer is not having exams at all. Would that have worked better for poor kids? Colleges would have been forced to use the same (or similar) info for their admissions that the computer used for exam: "an array of student information, including teacher-estimated grades and past performance by students in each school".

 

There is also a conclusion by author: "Algorithms should not be used to assign student grades."

This is bullcrap. First of all, they already are with pretty much zero opposition: https://www.ets.org/gre/revised_general/scores/how/ (yeah, human is in the loop, but still)

Second, the answer is to improve algorithms rather than discard them.

 

Author also is wrong on a number of other counts: they don't agree with "Computers make neutral decisions" - yeah, computers can have bias, but human graders definitely have bias - and are susceptible to fatigue, misunderstandings, and even fraud. I'd guess that's one of the reasons why ETS uses algorithmic scorer in addition to human one.

 

Author tries to score a lot of points with claims: "Algorithms can’t monitor or detect hate speech, ... they can’t predict crime, they can’t determine which job applicants are more suited than others, they can’t do effective facial recognition" - except that algorithms can do all of these and they do all of these and they are getting better in doing all of these. Yeah, you can prohibit using AI for facial recognition by law, but it does not mean that algorithms are or won't be better in recognizing people than people are.

 

Anyway, it sucks to be caught in this, but the way to go is to improve algorithms rather than giving up and going back to warm and fuzzy human-graded default.

 

Yeah, I didn't claim that use of algorithms is bad in all cases (I'm not a luddite). Also the author is certainly biased herself in many ways. But I do think the academic process such as admission is opaque to start with, has become highly political and contentious with emotions running high. We don't need another dose of opaque criterion in this mix right now. If we can lay out the rules of the game beforehand, that will help (this applies to the current process as well). The way I understood, there was no attempt to explain how the algorithm reached its decision (for example provide weight on each of the factors chosen by the algorithm). Without transparency this is a recipe for disaster.

Posted

If we can lay out the rules of the game beforehand, that will help (this applies to the current process as well). The way I understood, there was no attempt to explain how the algorithm reached its decision (for example provide weight on each of the factors chosen by the algorithm). Without transparency this is a recipe for disaster.

 

Sure, I agree that rules should be known beforehand as much as possible. Unfortunately with Covid pandemic, there was a pretty short period of time to react. I think the only solution that might have satisfied people would have been remote exams graded by humans. But I think authorities may not have had resources for that or maybe were concerned about fraud and maybe accessibility for poor students.

 

I mostly agree regarding transparency, though if you are transparent, then you cannot use "teacher-estimated grades". These will immediately inflate once teachers know that they are used for determining ultimate score.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now



×
×
  • Create New...