__TOC__

== DirectScreen Technology  [[Image:IMacros-icon.png|iMacros Browser]] [[Image:Ie-icon.png|IE Plug-in]]==

(Related example macros: Demo-FileUpload, Demo-Flash, Demo-Winclick)

DirectScreen (DS) Technology is the ultimate solution if everything else fails! It simulates standard native mouse clicks within the browser window. It is activated during recording by clicking on the "Click Mode" button and selecting "Use DirectScreen Commands" from the dialog.

Typically DirectScreen Technology is used to automate web pages that contain non-HTML elements such as '''Java applets, Adobe Flash,  Adobe Flex, Microsoft Silverlight or ActiveX controls'''. It also automates even the most complicated '''AJAX''' based website.

 [[Image:flash_page.png|left|thumb|300px|Flash applet simulating a calculator]]
[[Image:Example-javascript-ds.png|center|thumb|300px|Example of a tricky (non-standard) Javascript overlay dialog that is best automated with DirectScreen. ]]


== Recording DirectScreen commands [[Image:IMacros-icon.png|iMacros Browser]] [[Image:Ie-icon.png|IE Plug-in]]==

When working with non-HTML technologies like Flash or Java (Example: [http://demo.imacros.net/Automate/FlashDemo calculator]), iMacros can no longer work on the HTML code of the relevant page. To record a macro on a flash or Java applet, you must activate DirectScreen:
[[Image:Select_click_mode_DS.png|right|thumb|150px|Click Mode Selection]] 
1. Press the "Click Mode" button

2. Select "Use Direct Screen Commands ..." from the settings pop-up

3. Use the applet


You will find iMacros record the mouse and keyboard actions producing lots of DS and WAIT commands (depending on the complexity of the performed actions). The following section explains, why.


==How to define coordinates==
There are several methods to define coordinates for a DirectScreen command:

1. Absolute value: 

 DS CMD=MOVETO X=455 Y=224     

2. Center of HTML element, as defined by the preceding [[TAG]] command. This is especially useful for use with AJAX elements. 
 DS CMD=MOVETO X={{!<nowiki>TAGX}}</nowiki> <nowiki>Y={{!TAGY}}    </nowiki>


3. Center of image, as defined by the preceding [[IMAGESEARCH]] command. An image can be everything on the website, this is not limited to embedded HTML images.
 DS CMD=MOVETO <nowiki>X={{!IMAGEX}} Y={{!IMAGEY}}</nowiki>

==Why are there so many WAIT statements?==
 [[Image:DS_with_WAIT_statements.png|right|thumb|300px|DirectScreen Default Settings]]
If you choose the DirectScreen default settings, iMacros records the actions at original speed, i.e. it does not only record the clicks, but also how long you wait between two actions (like "move", "press left mouse button", "release left mouse button", etc.). These time intervals are simulated by [[WAIT]] statements in the macro, which make iMacros, well, wait before performing the next command. This way, the applet has enough time to react to the actions taken.

If you notice that the applet is much faster than the users action, you can try to shorten the WAIT times by editing the macro. But note that the applet typically needs at least ''some'' time to respond. As an alternative to WAIT statements you can use the <nowiki>{{IMAGESEARCH}}</nowiki> command, which scans the browser screen until the specified image (e. g. image of a button or text) appears.

==Entering Text==
When using the DS click mode, DS also records text input by using the "DS CMD=KEY" command. You can use the <nowiki>{BACKSPACE}</nowiki> command to overwrite existing text. Here's an example:

 <nowiki>
VERSION BUILD=10.4.28.1074
TAB T=1
TAB CLOSEALLOTHERS
URL GOTO=http://www.amazon.de/
SIZE X=845 Y=855
WAIT SECONDS=0.094
DS CMD=MOVETO X=286 Y=62 CONTENT=
WAIT SECONDS=0.421
DS CMD=LDOWN X=286 Y=63 CONTENT=
WAIT SECONDS=0.39
DS CMD=LUP X=286 Y=63 CONTENT=
WAIT SECONDS=1.016
DS CMD=KEY CONTENT=Kindle
WAIT SECONDS=0.968
WAIT SECONDS=0.125
DS CMD=MOVETO X=587 Y=71 CONTENT=
WAIT SECONDS=1.0
DS CMD=KEY CONTENT={ENTER}
WAIT SECONDS=0.109
DS CMD=MOVETO X=66 Y=234 CONTENT=
</nowiki>

== SYNTAX ==
 DS CMD=command X=coordinate Y=coordinate [CONTENT=some_content]
== Parameters ==
* CMD
*: The command/action to be performed
* commands:
** CLICK
**: behaves like (old) [[WINCLICK]]. Technically this is a combination of the MOVE, LDOWN, LUP and KEY commands.
** LDBLCLK
**: Simulate left double click (at position). When recording with the "Record all DirectScreen commands" option enabled, the correct sequence of commands is recorded for the LDBLCKL to work on playback. When using "Record only mouse clicks," LDBLCLK is not recorded, but you can manually add the following sequence of commands for a double-click: LDOWN, LUP, LDBLCLK, LUP.
** LDOWN
**: Simulate left mouse button being pressed (at position)
** LUP
**: Simulate left mouse button being released (at position)
** MOVETO
**: Moves pointer (to position)
** MDOWN
**: Simulate middle mouse button being pressed (at position)
** MUP
**: Simulate middle mouse button being released (at position)
** MDBLCLK
**: Simulate middle double click (at position)
** RDOWN
**: Simulate right mouse button being pressed (at position)
** RUP
**: Simulate right mouse button being released (at position)
** RDBLCLK
**: Simulate right double click (at position)
** SCREENSHOT '''(deprecated in iMacros 7!)'''
**: Take screenshot. This command is useful for screenshots of applets, where the normal screenshot feature does not work. The path for the screenshot is in the content attribute, e. g. ''DS CMD=SCREENSHOT X=380 Y=220 CONTENT=c:\myscreenshots\screen1.bmp''. The X/Y coordinates can be anywhere, but have to be inside the area from which you need to take the screenshot. So if you want take a screenshot of a [http://www.iopus.com/imacros/demo/v6/java/calc/ page with a Java applet,] the coordinates should be somewhere inside the Java applet, otherwise this area will remain black. Several screenshots can be combined in one with the SCREENSHOTINCLUDE command.
** KEY
**: Enter text, perform key sequence. Specify the keys/text to enter in the CONTENT parameter.
**: Special commands for the KEY command:
**: <nowiki>{BACKSPACE}</nowiki> Deletes one character. Use several BACKSPACE commands to delete more characters or CONTENT=#ERASEALL# to clear the whole field.
**: <nowiki>{ENTER}</nowiki> "Press" the Enter key.
<!--
**: <nowiki>{INSERT}</nowiki> "Press" the Insert key.
**: <nowiki>{DELETE}</nowiki> "Press" the Delete key.
**: <nowiki>{HOME}</nowiki> "Press" the Home key.
**: <nowiki>{END}</nowiki> "Press" the end key.
**: <nowiki>{PAGEUP}</nowiki> "Press" the PageUp key.
**: <nowiki>{PAGEDOWN}</nowiki> "Press" the PageDown key.
**: <nowiki>{LEFT}</nowiki> "Press" the Left Arrow key.
**: <nowiki>{RIGHT}</nowiki> "Press" the Right Arrow key.
**: <nowiki>{UP}</nowiki> "Press" the Up Arrow key.
**: <nowiki>{DOWN}</nowiki> "Press" the Down Arrow key.
**: <nowiki>---</nowiki>
-->
**: '''Note:''' The modifier keys {SHIFT}, {CTRL}, and {ALT} are currently not supported, nor is {TAB}, {ESC} and others not listed here.
* CONTENT
*: Specifies the content to send to the selected element. Specify CONTENT=#ERASEALL# to clear the entire field.
   Example:
   DS CMD=CLICK X=411 Y=434 CONTENT=#ERASEALL#
   DS CMD=KEY X=411 Y=434 CONTENT=#ERASEALL#

== See Also ==

* [http://forum.iopus.com/viewtopic.php?f=6&t=301 How to use DirectScreen with web page elements below the fold.]
* [[FAQ#Q:_What_factors_can_cause_the_image_recognition_or_DirectScreen_to_fail_on_one_machine_whereas_it_is_working_on_others.3F|What factors can cause the image recognition or DirectScreen to fail on one machine whereas it is working on others?]]
* [http://forum.iopus.com/viewtopic.php?t=9543 Which technologies are supported in tray/silent mode]
* [http://forum.iopus.com/viewtopic.php?f=11&t=19209 Workaround for lack of DS mouse commands in iMacros for Firefox]