:))) this look very complicated, in meaning its to much job to do and + it's slow, very slow. Program need to do pixel recognition or whatever for that matter must be slow. You aiming to replace ubot and Imacro, sorry to tell you this but you are just outclass by both. Incredibly outclass. Alto both of those programs can't operate on application YET, they kick ass on web, which matters. Since you are obviously good with picture recognition why not making some capcha recognition bot, much better
The combination with MT would be nice. It adds another dimension...instead of programming (cod +screenshot caption) .. it can perhaps learn the same thing by just using gestures (making ellipse gesture around what u gonna choose =which region to remember + click) . Not needed to program click all the time. It would be only usefull to restructure things after the whole process. It would make it somewhat faster.
I've wanted a program like this for a while, and this is perfect! If it uses structures like "if" meaning if you see this or if you see that or only if you see this AND that...wow.
Wow, this is impressive, we all know how boring is to do all this by cmd, or even in C. This may be slow, but hey! not everyday you get the things done just by taking screenshots =).
@cumulus0007 exactly, this is an abomination, why not just learn a real programming language and do a system call that will do the same IN THE BACKGROUND???. mac people are so retarded jesus crist.
im getting error every time i try to run script java.lang.UnsatisfiedLinkError: java.lang.UnsatisfiedLinkError: C:\Program Files\Sikuli\tmplib\VDictProxy.dll: This application has failed to start because the application configuration is incorrect. Reinstalling the application may fix this problem
How to use in Windows? I've tried switchApp("firefox.exe") but it does not run FF whereas running firefox.exe from Run runs it fine, is switchApp not the correct process for Windows? I cannot seem to find any documentation on processes?
@ashconnor Probably, but blackjack input isn't the same step-by step process as network configuration. You'd have to create your own dynamic blackjack AI as well ;)
@xNAgff dont mention that you can execute a command thought a real programming language like C/C++, or even use a system library to do it more cleanly.
VBA "programmers" of Office addins have been known to send keystrokes of shortcuts to apps when they couldn't figure out the API but both approaches seem to rely on a simplified subset of the interaction - as such I wonder how this would handle an unexpected error dialog being presented / or a user trying to do something else at the same time as the script is running
Anyone able to get the command line version to work on a mac? I get this error...
Exception in thread "main" java.lang.UnsupportedClassVers ionError: Bad version number in .class file. According to mac im updated to the latest version of java... Standard Edition 6, 12.5.0
if a company wants help their customer to make auto fill app for their client this can make it difficult when people have different themes on their computer, depends how Sikuli was written but i don't think its written in that way yet. So they would have detect theme first then say "please switch to your default theme in order for us to help you" something like that
This is an amazing idea (GUI scripting), but I'm worried it's ultra slow. I suggest a speed improvement (though you've probably implemented it already): start the search from the last known position of the "click" object, relative to the foreground window, and then search in a pattern of a spiral from that point outwards.
Yes, I saw on the video description 'OS X and windows' but have since visited the site and have downloaded the Linux version to test. Seems to have trouble with the screen interactions though in KDE 3+.
I would assume that the Sikuli engine gets around that in one of three ways:
1. It could only consider the current active window (e.g, if you started typing, the window your characters would appear in).
2. It could give priority to areas of the screen that have been recently updated.
3. The first thing she did was tell Sikuli to open up System Preferences - it could take that as a signal to only consider the System Preferences window and its children.
you have a very delightful voice O.o :)
adlsfreund 3 weeks ago
sounds like backup any setting action.
funkhop 7 months ago
This is awesome, really, very good job! I will definitely check on this.
DGalizzi 7 months ago
我看到中文了
LEGO0018 8 months ago
is it possible to make a game using this sikuli visual scripting?
21EC 8 months ago
Instead of "type()" I would use "paste( )", "type("\t")" this would improve performance
hanfiking 9 months ago
:))) this look very complicated, in meaning its to much job to do and + it's slow, very slow. Program need to do pixel recognition or whatever for that matter must be slow. You aiming to replace ubot and Imacro, sorry to tell you this but you are just outclass by both. Incredibly outclass. Alto both of those programs can't operate on application YET, they kick ass on web, which matters. Since you are obviously good with picture recognition why not making some capcha recognition bot, much better
crashxxx 10 months ago
Damn, you ruined the whole presentation with this *supposedly* Korean/Chinese whatever woman speaking.....
Fevernew 11 months ago
remember guys, this was just an example with what you could do with this... there is many other things you could do... :D its just soooo easy
EvilSiper 11 months ago
This has been flagged as spam show
Meet real hot ladies through Naughty mworld5.info
kumari5789 1 year ago
Comment removed
dralezero 1 year ago
Oh, so it's Java? No wonder it is so slow. :D
ShadowwwLFS 1 year ago 3
autohotkey
laputahayom 1 year ago
Incomprehensible.
Where did you find her? At a Calcuttan call center?
Find someone who's fluent in spoken, unaccented English.
Simply look outside of stinking-student Cambridge, MA and avoid anyone with a thick Boston accent .
LookAtMyTube 1 year ago
@LookAtMyTube there is no such thing as accentless English.
freezombie 1 year ago
@LookAtMyTube I understood her fine, it's your problem.
Darkray16 1 year ago
i cant take screen shots the screen wont darken plz help
imnathan252l 1 year ago
Nice
zyrgzyrg 1 year ago
sub x sub
puseze 1 year ago
having problems getting menus to work under linux/gnome/ubuntu
lowtone10 1 year ago
wouldnt it be easier to record a macro using winautomation or similar software?
that would've taken 1 min max
adriannaholdrenscs 1 year ago
@adriannaholdrenscs winautomation costs $130...
taylornate2 1 year ago
very nice idea.
The combination with MT would be nice. It adds another dimension...instead of programming (cod +screenshot caption) .. it can perhaps learn the same thing by just using gestures (making ellipse gesture around what u gonna choose =which region to remember + click) . Not needed to program click all the time. It would be only usefull to restructure things after the whole process. It would make it somewhat faster.
Lvn369 1 year ago
awesome
shishi4yt 1 year ago
I've wanted a program like this for a while, and this is perfect! If it uses structures like "if" meaning if you see this or if you see that or only if you see this AND that...wow.
P00P0STER0US 2 years ago
Love it! Wow!
P00P0STER0US 2 years ago
Interesting idea. Seems to work fine.
But WHY WHY WHY ruin the demo with this VOICE. It sounds like an old scifi robot talking through a pipe.
ErMejo74 2 years ago
Uh, maybe she's one of the developers? Sounds just fine to me.
P00P0STER0US 2 years ago
@ErMejo74 And the accent!
"CLICKING THE RUMP BUTTON" (6:00)
bikutorusan 1 year ago
I have been using AutoIt on Windows machines but this seems much more intuitive. I'm sold.
aikaha 2 years ago
Intuitive programming, trade-off is its speed. Can't all those mouse moving be skipped so that it may be faster?
dgg32 2 years ago 2
it is a very usefull thing but it depend on screenshot aspects and i can use it only for my own computer, so how i can share scripts?
energioz 2 years ago
Is she iranian?
Jaeboy 2 years ago
Wow, this is impressive, we all know how boring is to do all this by cmd, or even in C. This may be slow, but hey! not everyday you get the things done just by taking screenshots =).
Play2Music
Play2Music 2 years ago
Absolutely awesome.
I'm sure you could have chosen a better narrator though.
houou100 2 years ago
ATMTA
etta777 2 years ago
Хотя, с другой стороны, не бесполезная фигня.
etta777 2 years ago
it's a little bit too slow
yalewhd 2 years ago
"бантики" для "хомячков"
LunaticAAC 2 years ago
Да уж... Весело...
Но для некоторых вещей удобно. А то я как-то писал скриптовый язык для того, чтобы некотовые проги ставились автоматом... Не очень приятно.
ZZZSochi 2 years ago
it's a neat way to improve Automator, but it's so SLOW. Is there no way to speed up the steps when it executes?
voyowee 2 years ago
Wow,
going to try it now.
SelectiveApathy 2 years ago
This is amazing.
synack 2 years ago
Why all this work instead of a simple
ifconfig eth0 123.456.7.8.
cumulus0007 2 years ago 23
@cumulus0007 cuz XXX.456.XXX.XXX is an invalid IPv4 address
eatbetter 1 year ago
@cumulus0007 exactly, this is an abomination, why not just learn a real programming language and do a system call that will do the same IN THE BACKGROUND???. mac people are so retarded jesus crist.
kukovrein 2 months ago
Programming for lazy people. Just like Vissual Basic.
cumulus0007 2 years ago 4
amazing.but it is just a little bit much too slow.
asdfgzxcvbn 2 years ago 19
im getting error every time i try to run script java.lang.UnsatisfiedLinkError: java.lang.UnsatisfiedLinkError: C:\Program Files\Sikuli\tmplib\VDictProxy.dll: This application has failed to start because the application configuration is incorrect. Reinstalling the application may fix this problem
i have java6 installed
aegars 2 years ago
this is look like something match the quickmacro
Kimfatt 2 years ago
How to use in Windows? I've tried switchApp("firefox.exe") but it does not run FF whereas running firefox.exe from Run runs it fine, is switchApp not the correct process for Windows? I cannot seem to find any documentation on processes?
BlogRefinancing 2 years ago
@BlogRefinancing According to the documentation, Firefox should already be running, and you use the text in the title bar, rather than firefox.exe .
SJGster 2 years ago
this seems wicked, for a non-programmer like me that would like to automate several boring tasks i have to do. thanks!
The website seems down at the moment, though...
CowardsBendTheKnee 2 years ago
I could I use this to create a bot that would play blackjack for me? Even if the Casino client is in flash?
ashconnor 2 years ago
@ashconnor Probably, but blackjack input isn't the same step-by step process as network configuration. You'd have to create your own dynamic blackjack AI as well ;)
0verk0rd 2 years ago
This seems much more fragile than just using the command line.
xNAgff 2 years ago
@xNAgff dont mention that you can execute a command thought a real programming language like C/C++, or even use a system library to do it more cleanly.
kukovrein 2 months ago
VBA "programmers" of Office addins have been known to send keystrokes of shortcuts to apps when they couldn't figure out the API but both approaches seem to rely on a simplified subset of the interaction - as such I wonder how this would handle an unexpected error dialog being presented / or a user trying to do something else at the same time as the script is running
nat4200 2 years ago 2
This has been flagged as spam show
Anyone able to get the command line version to work on a mac? I get this error...
Exception in thread "main" java.lang.UnsupportedClassVers ionError: Bad version number in .class file. According to mac im updated to the latest version of java... Standard Edition 6, 12.5.0
nhaskins401 2 years ago
Comment removed
nhaskins401 2 years ago
不实用,如果电脑里有相同的图标怎么办?
yourliang 2 years ago
圖下的字也包了阿
businessman97 2 years ago
if a company wants help their customer to make auto fill app for their client this can make it difficult when people have different themes on their computer, depends how Sikuli was written but i don't think its written in that way yet. So they would have detect theme first then say "please switch to your default theme in order for us to help you" something like that
fufueater 2 years ago
This is an amazing idea (GUI scripting), but I'm worried it's ultra slow. I suggest a speed improvement (though you've probably implemented it already): start the search from the last known position of the "click" object, relative to the foreground window, and then search in a pattern of a spiral from that point outwards.
paxcoder 2 years ago
There are modifiers you can string onto the commands so you can search just to the right, within, or below regions.
n0nzer0 2 years ago
why so slow?
olborer 2 years ago 2
i guess it tries pixel per pixel until find something like we want....idk...
LordOfDragonMasters 2 years ago
How is this programming?
cyberixae 2 years ago
vgod 是台灣之光 ^.^
wtkao 2 years ago
Comment removed
gogger 2 years ago
Comment removed
gogger 2 years ago
速度有点慢,图形识别占的时间吧。
占资源多吗?好像没说。这个就是个更高级的宏吧。
gzycrosslife 2 years ago
Not fast by any means but cool as hell!!!!!!
e633xx 2 years ago
definitely interesting but what i dont like about it that it locks down your interaction while the script runs..
okay its "kinda fast" but for me script and automations should run in the background and free the time for me to do other things.
anyhow this is definitely a cool and intuitive way to get more people into programming.
oObsi 2 years ago
This comment has received too many negative votes show
How did she get into mit, obviously they don't teach grammar either...
narcoti 2 years ago
You should translate this video into your second language. We'll all be judging you. :-)
pahhoehoe122 2 years ago
hmm I thought macro's did this already....
narcoti 2 years ago
Is it only me or was it very very slow? Up to the type in part, I could've done it faster by hand.
Lohkay 2 years ago
wow.
quakefiend 2 years ago
Plans for linux/freebsd/etc releases?
xiaomutaku 2 years ago
It's based on Jython so it should work anywhere Java runs.
mesterha 2 years ago
Yes, I saw on the video description 'OS X and windows' but have since visited the site and have downloaded the Linux version to test. Seems to have trouble with the screen interactions though in KDE 3+.
xiaomutaku 2 years ago
This is great progress!
In another ten years or so, we will be teaching chimpanzees how to program. :-D
Arancaytar 2 years ago 2
How do you resolve a situation where there might be one or more OK/SAVE/CANCEL buttons in the background?
hadlock 2 years ago 4
I would assume that the Sikuli engine gets around that in one of three ways:
1. It could only consider the current active window (e.g, if you started typing, the window your characters would appear in).
2. It could give priority to areas of the screen that have been recently updated.
3. The first thing she did was tell Sikuli to open up System Preferences - it could take that as a signal to only consider the System Preferences window and its children.
IICVX 2 years ago
cool...just curious. can i compile sikuli script become a regular application? what i need is to pack sikuli script as a standalone binary. thanks
samtz1223 2 years ago 4
We don't have a compiler yet, but a command line interpreter is available on the website.
vgodtw 2 years ago