testing/smoketests.html

   1 <html>
   2
   3         <meta http-equiv="content-type" content="text/html;charset=iso-8859-1">
   4
   5         <body>
   6                 <h1>OpenOCD smoketest results</h1>
   7                 These tests can be performed on any JTAG device as long as they are executed using the unmodified code from SVN.
   8                 <p>The latest version in which the test is known to have passed is in the table below.</p>
   9                 <h2>Vocabulary</h2>
  10                 <table border="1">
  11                         <tr>
  12                                 <td width="100">Passed version</td>
  13                                 <td>The latest branch and version on which the test is known to pass</td>
  14                         </tr>
  15                         <tr>
  16                                 <td width="100">Broken version</td>
  17                                 <td>The latest branch and version on which the test is known to fail. n/a when older than passed version.</td>
  18                         </tr>
  19                         <tr>
  20                                 <td width="100">ID</td>
  21                                 <td>A unqiue ID to refer to a test. The unique numbers are maintained in this file. Note that the same test can be run on different hardware/interface. Each combination yields a unique id. </td>
  22                         </tr>
  23                 </table>
  24                 <p></p>
  25                 <table border="1">
  26                         <tr>
  27                                 <th width="100">Unique ID</th>
  28                                 <th width="165">Synopsis</th>
  29                                 <th align="center" width="110">JTAG device</th>
  30                                 <th align="center" width="110">Passed version</th>
  31                                 <th align="center" width="110">Broken version</th>
  32                         </tr>
  33                         <tr>
  34                                 <td >fill_malloc</td>
  35                                 <td width="165">Fill malloc() memory with garbage</td>
  36                                 <td align="center" >n/a</td>
  37                                 <td align="center" >n/a</td>
  38                                 <td align="center" >n/a</td>
  39                         </tr>
  40                         <tr>
  41                                 <td >ocd1</td>
  42                                 <td width="165">Telnet Windows</td>
  43                                 <td align="center" >n/a</td>
  44                                 <td align="center" >n/a</td>
  45                                 <td align="center" >n/a</td>
  46                         </tr>
  47                         <tr>
  48                                 <td >ocd2</td>
  49                                 <td width="165">Telnet Linux</td>
  50                                 <td align="center" >n/a</td>
  51                                 <td align="center" >n/a</td>
  52                                 <td align="center" >n/a</td>
  53                         </tr>
  54                         <tr>
  55                                 <td >ocd3</td>
  56                                 <td width="165">Telnet Cygwin</td>
  57                                 <td align="center" >n/a</td>
  58                                 <td align="center" >n/a</td>
  59                                 <td align="center" >n/a</td>
  60                         </tr>
  61                         <tr>
  62                                 <td ><a href="#test_ocd4">ocd4</a></td>
  63                                 <td width="165">ARM7 debugging</td>
  64                                 <td align="center" >n/a</td>
  65                                 <td align="center" >n/a</td>
  66                                 <td align="center" >n/a</td>
  67                         </tr>
  68                         <tr>
  69                                 <td >SAM9260</td>
  70                                 <td width="165">SAM9260 debugging</td>
  71                                 <td align="center">ft2232 </td>
  72                                 <td align="center">500</td>
  73                                 <td align="center">n/a</td>
  74                         </tr>
  75                         <tr>
  76                                 <td >xscale1</td>
  77                                 <td width="165">XScale debugging</td>
  78                                 <td align="center" >bitbang</td>
  79                                 <td align="center" >505</td>
  80                                 <td align="center" >n/a</td>
  81                         </tr>
  82                         <tr>
  83                                 <td >xscale2</td>
  84                                 <td width="165">XScale debugging</td>
  85                                 <td align="center" >FT2232</td>
  86                                 <td align="center" >202</td>
  87                                 <td align="center" >n/a</td>
  88                         </tr>
  89                         <tr>
  90                                 <td ><a href="#bdte-ram">bdte-ram1</a></td>
  91                                 <td width="165">str710 ram debugging</td>
  92                                 <td align="center" >JTAGkey</td>
  93                                 <td align="center" >657</td>
  94                                 <td align="center" >n/a</td>
  95                         </tr>
  96                         <tr>
  97                                 <td ><a href="#bdte-rom">bdte-rom2</a></td>
  98                                 <td width="165">str710 rom debugging</td>
  99                                 <td align="center" >JTAGkey</td>
 100                                 <td align="center" >657</td>
 101                                 <td align="center" >n/a</td>
 102                         </tr>
 103                         <tr>
 104                                 <td ><a href="#bdte-ram">bdte-ram3</a></td>
 105                                 <td width="165">str912 ram debugging</td>
 106                                 <td align="center" >JTAGkey</td>
 107                                 <td align="center" >657</td>
 108                                 <td align="center" >n/a</td>
 109                         </tr>
 110                         <tr>
 111                                 <td ><a href="#bdte-rom">bdte-rom4</a></td>
 112                                 <td width="165">str912 rom debugging</td>
 113                                 <td align="center" >JTAGkey</td>
 114                                 <td align="center" >657</td>
 115                                 <td align="center" >n/a</td>
 116                         </tr>
 117                         <tr>
 118                                 <td ><a href="#bdte-ram">bdte-ram5</a></td>
 119                                 <td width="165">lpc2148 ram debugging</td>
 120                                 <td align="center" >JTAGkey</td>
 121                                 <td align="center" >657</td>
 122                                 <td align="center" >n/a</td>
 123                         </tr>
 124                         <tr>
 125                                 <td ><a href="#bdte-rom">bdte-rom6</a></td>
 126                                 <td width="165">lpc2148 rom debugging</td>
 127                                 <td align="center" >JTAGkey</td>
 128                                 <td align="center" >657</td>
 129                                 <td align="center" >n/a</td>
 130                         </tr>
 131                         <tr>
 132                                 <td ><a href="#bdte-ram">bdte-ram7</a></td>
 133                                 <td width="165">lpc2294 ram debugging</td>
 134                                 <td align="center" >JTAGkey</td>
 135                                 <td align="center" >657</td>
 136                                 <td align="center" >n/a</td>
 137                         </tr>
 138                         <tr>
 139                                 <td ><a href="#bdte-rom">bdte-rom8</a></td>
 140                                 <td width="165">lpc2294 rom debugging</td>
 141                                 <td align="center" >JTAGkey</td>
 142                                 <td align="center" >657</td>
 143                                 <td align="center" >n/a</td>
 144                         </tr>
 145                         <tr>
 146                                 <td ><a href="#bdte-ram">bdte-ram9</a></td>
 147                                 <td width="165">sam7s256 ram debugging</td>
 148                                 <td align="center" >JTAGkey</td>
 149                                 <td align="center" >657</td>
 150                                 <td align="center" >n/a</td>
 151                         </tr>
 152                         <tr>
 153                                 <td ><a href="#bdte-rom">bdte-rom10</a></td>
 154                                 <td width="165">sam7s256 rom debugging</td>
 155                                 <td align="center" >JTAGkey</td>
 156                                 <td align="center" >657</td>
 157                                 <td align="center" >n/a</td>
 158                         </tr>
 159                         <tr>
 160                                 <td ><a href="#bdte-ram">bdte-ram11</a></td>
 161                                 <td width="165">sam7x256 ram debugging</td>
 162                                 <td align="center" >JTAGkey</td>
 163                                 <td align="center" >657</td>
 164                                 <td align="center" >n/a</td>
 165                         </tr>
 166                         <tr>
 167                                 <td ><a href="#bdte-rom">bdte-rom12</a></td>
 168                                 <td width="165">sam7x256 rom debugging</td>
 169                                 <td align="center" >JTAGkey</td>
 170                                 <td align="center" >657</td>
 171                                 <td align="center" >n/a</td>
 172                         </tr>
 173                         <tr>
 174                                 <td ><a href="#bdte-ram">bdte-ram13</a></td>
 175                                 <td width="165">at91r40008 ram debugging</td>
 176                                 <td align="center" >JTAGkey</td>
 177                                 <td align="center" >657</td>
 178                                 <td align="center" >n/a</td>
 179                         </tr>
 180                 </table>
 181                 <p></p>
 182                 <hr>
 183                 <h1>OpenOCD JTAG device test results</h1>
 184                 Each JTAG device must be tested
 185
 186                 <table border="1">
 187                         <tr>
 188                                 <th align="center" width="40">ID</th>
 189                                 <th width="90">Synopsis</th>
 190                                 <th >Passed version</th>
 191                                 <th >Broken version</th>
 192                         </tr>
 193                         <tr>
 194                                 <td width="40">jtag1</td>
 195                                 <td width="90">Parport</td>
 196                                 <td align="center" >n/a</td>
 197                                 <td align="center" >n/a</td>
 198                         </tr>
 199                         <tr>
 200                                 <td width="40">jtag2</td>
 201                                 <td width="90">JTAGkey</td>
 202                                 <td align="center" >657</td>
 203                                 <td align="center" >n/a</td>
 204                         </tr>
 205                         <tr>
 206                                 <td width="40">jtag3</td>
 207                                 <td width="90">Turtelizer2</td>
 208                                 <td align="center" >657</td>
 209                                 <td align="center" >n/a</td>
 210                         </tr>
 211                         <tr>
 212                                 <td width="40">jtag4</td>
 213                                 <td width="90">JTAGkey</td>
 214                                 <td align="center" >657</td>
 215                                 <td align="center" >n/a</td>
 216                         </tr>
 217                         <tr>
 218                                 <td width="40">jtag5</td>
 219                                 <td width="90">add new one</td>
 220                                 <td align="center" >n/a</td>
 221                                 <td align="center" >n/a</td>
 222                         </tr>
 223                 </table>
 224                 <p>jtag1:</p>
 225                 <p>jtag2: Tested on Windows XP Prof. (SP2) with original FTDI&nbsp;driver.</p>
 226                 <p>jtag3: Tested on Windows XP Prof. (SP2) with original FTDI&nbsp;driver.</p>
 227                 <p>jtag4: Tested on Mac OS X (10.5.2, Intel) with libftdi-0.10 and libusb-0.1.12</p>
 228                 <p>jtag5:</p>
 229                 <hr>
 230                 <h1>OpenOCD JTAG device speed test result</h1>
 231                 <p>The test result is in KB/sec.</p>
 232                 <table border="1">
 233                         <tr>
 234                                 <th align="center" width="50">ID</th>
 235                                 <th width="90">Synopsis</th>
 236                                 <th width="40">r320</th>
 237                                 <th width="40">r420</th>
 238                                 <th width="40">r423</th>
 239                                 <th width="40">r459</th>
 240                                 <th width="40">r517</th>
 241                                 <th width="40">r536</th>
 242                                 <th width="40">r651</th>
 243                                 <th width="40">r657</th>
 244                         </tr>
 245                         <tr>
 246                                 <td width="50"><a href="#speed1">speed1</a></td>
 247                                 <td width="90">JTAGkey</td>
 248                                 <td align="center" width="40">93</td>
 249                                 <td align="center" width="40">64 </td>
 250                                 <td align="center" width="40">93</td>
 251                                 <td align="center" width="40">93</td>
 252                                 <td align="center" width="40">93</td>
 253                                 <td align="center" width="40">93</td>
 254                                 <td align="center" width="40">162</td>
 255                                 <td align="center" width="40">165</td>
 256                         </tr>
 257                         <tr>
 258                                 <td width="50"><a href="#speed2">speed2</a></td>
 259                                 <td width="90">JTAGkey</td>
 260                                 <td align="center" width="40">n/a</td>
 261                                 <td align="center" width="40">n/a</td>
 262                                 <td align="center" width="40">n/a</td>
 263                                 <td align="center" width="40">n/a</td>
 264                                 <td align="center" width="40">52</td>
 265                                 <td align="center" width="40">52</td>
 266                                 <td align="center" width="40">110</td>
 267                                 <td align="center" width="40">111</td>
 268                         </tr>
 269                         <tr>
 270                                 <td width="50">speed3</td>
 271                                 <td width="90">add new one</td>
 272                                 <td align="center" width="40">n/a</td>
 273                                 <td align="center" width="40">n/a</td>
 274                                 <td align="center" width="40">n/a</td>
 275                                 <td align="center" width="40">n/a</td>
 276                                 <td align="center" width="40">n/a</td>
 277                                 <td align="center" width="40">n/a</td>
 278                                 <td align="center" width="40">n/a</td>
 279                                 <td align="center" width="40">n/a</td>
 280                         </tr>
 281                 </table>
 282                 <p></p>
 283                 <hr>
 284                 <h1>Policy on removing features from OpenOCD</h1>
 285                 If a feature in OpenOCD is known to be broken and nobody has submitted a fix and the feature is causing trouble for maintainence, it can be removed from OpenOCD trunk. The threshold for temporarily removing something from OpenOCD trunk is low to ease maintainence and place the burden of maintainence on those that care about a feature.
 286                 <p>Note that code is never deleted from OpenOCD svn, it remains in svn so if somebody sees a feature removed that they would like kept, they have but to port and fix that feature back up to main trunk. This document can be helpful in this regard in that the latest working version and the known broken version may be listed.</p>
 287                 <h1>Policy on adding features from OpenOCD</h1>
 288                 To add a feature to OpenOCD, generally it should not break any existing features and it should be functional and the code reasonably readable and useful to others in the OpenOCD community. The code does not have to be completed. Work in progress is fine for OpenOCD trunk.
 289                 <p>Also new tests should be defined. Note that the code does not have to pass all the tests. In fact it can be helpful to have tests to describe facets that really should be working, but aren't done yet. </p>
 290                 <hr>
 291                 <h1>ocd4 - ARM7 debugging<a name="test_ocd4"></a></h1>
 292                 Connect to ARM7 device(any), use GDB load to load a program into RAM and single halt, resume and single step.
 293                 <hr>
 294                 <h1>bdte-ram (Basic debugging test with Eclipse in RAM)<a id="bdte-ram" name="bdte-ram"></a></h1>
 295                 <p>This test was made under Eclipse with the Zylin Embedded CDT&nbsp;plugin. For the GDB &quot;Initialize commands&quot; take a look in the examples/&lt;target&gt;/prj/<b>eclipse_ram.gdb</b> file.</p>
 296                 <p>Start debugging,  the debugger should stop at main. set some breakpoints and &quot;Resume&quot;. If the debugger hit a breakpoint check if the &quot;Variables&quot; looks correct. Remove some breakpoints and &quot;Resume&quot; again. If the target is running, use the &quot;Suspend&quot; function and use &quot;Step Into&quot; or &quot;Step Over&quot; through the source. Even open the &quot;Disassembly&quot; view and enable the &quot;Instruction Stepping Mode&quot;. Now you can single step through the assembler source. Use &quot;Resume&quot; again to run the program, set a breakpoint while the target is running. Check if  you can inspect the variables with the mouse over. Play a little with the target...</p>
 297                 <hr>
 298                 <h1>bdte-rom (Basic debugging test with Eclipse in ROM)<a id="bdte-rom" name="bdte-rom"></a></h1>
 299                 <p>This test was made under Eclipse with the Zylin Embedded CDT&nbsp;plugin. For the GDB &quot;Initialize commands&quot; take a look in the examples/&lt;target&gt;/prj/<b>eclipse_rom.gdb</b> file.</p>
 300                 <p>Start debugging, the debugger should download and store the program in the flash of the target.</p>
 301                 <p>Now you can make some tests like described in the <a href="#bdte-ram">bdte-ram</a> section above too.</p>
 302                 <hr>
 303                 <h1>speed1 - Download speed test<a id="speed1" name="speed1"></a></h1>
 304                 <p>For this test a STR710 with external memory was used. The example project can be found under examples/STR710JtagSpeed. Here Eclipse or the arm-elf-gdb can be used to download the test.elf file into the RAM. The result of the GDB&nbsp;can look like:</p>
 305                 <p>Loading section .text, size 0x6019c lma 0x62000000<br>
 306                         Start address 0x62000040, load size 393628<br>
 307                         Transfer rate: 93 KB/sec, 2008 bytes/write.</p>
 308                 <p>In this example a speed of 93 KB/sec was reached. The hardware which was used for the test can be found <a href="http://www.yagarto.de/projects/str7usbmsd/index.html" target="new">here</a>.</p>
 309                 <p>The test was made on Windows XP Prof. (SP2) with a JTAGkey and the original FTDI driver.</p>
 310                 <hr>
 311                 <h1>speed2 - Download speed test<a id="speed2" name="speed2"></a></h1>
 312                 <p>For this test a STR710 with external memory was used. The example project can be found under examples/STR710JtagSpeed. Here Eclipse or the arm-elf-gdb can be used to download the test.elf file into the RAM. The result of the GDB&nbsp;can look like:</p>
 313                 <p>Loading section .text, size 0x6019c lma 0x62000000<br>
 314                         Start address 0x62000040, load size 393628<br>Transfer rate: 52 KB/sec, 2008 bytes/write.</p>
 315                 <p>In this example a speed of 52 KB/sec was reached. The hardware which was used for the test can be found <a href="http://www.yagarto.de/projects/str7usbmsd/index.html" target="new">here</a>.</p>
 316                 <p>The test was made on Mac OS X (10.5.2, Intel)  with a JTAGkey and the following driver:</p>
 317                 <p>- libftdi 0.10<br>
 318                         - libusb 0.1.12</p>
 319                 <p></p>
 320                 <p></p>
 321         </body>
 322
 323 </html>