
w =

   -2.3026         0         0         0    2.3026         0   -2.3026         0


s = 

    'log(sexp.magnSigma2)'
    'prior-t.mu'
    'log(sexp.lengthScale)'
    'prior-t.mu'
    'log(linear.coeffSigma2)'
    'prior-t.mu'
    'log(gaussian.sigma2)'
    't.mu'

  Iteration  Func-count      f(x)      Lambda
      0          1          77.436    
      1          3         62.2251       10
      2          5         48.7816        5
      3          7         44.4582      2.5
      4          9         40.3733     1.25
      5         11         37.7161    0.625
      6         13         37.1274    0.312
      7         15         36.8407    0.156
      8         17         36.6905   0.0781
      9         19         36.5944   0.0391
     10         21         36.4577   0.0195
     11         23         36.4165   0.00977
     12         25         36.4114   0.00488
     13         27         36.4061   0.00244
     14         29         36.3983   0.00122
     15         31         36.3891   0.00061
     16         33         36.3852   0.000305
     17         35         36.3845   0.000153
     18         37         36.3834   7.63e-05
     19         39         36.3833   3.81e-05
  Iteration  Func-count      f(x)    Lambda
     20         41         36.3832   1.91e-05
     21         43         36.3832   9.54e-06
     22         45         36.3832   4.77e-06
     23         47         36.3832   2.38e-06
 TolFun reached. Func-count 47. Final f(x)=36.3832. Elapsed time 0.69
Checking gradient ...

   analytic   diffs     delta

   -0.0026   -0.0026    0.0000
    0.0016    0.0016   -0.0000
   -0.0004   -0.0004   -0.0000
   -0.0017   -0.0017   -0.0000
    0.0000    0.0000    0.0000
   -0.0008   -0.0008    0.0000
   -0.0041   -0.0041   -0.0000
    0.0000    0.0000    0.0000

  Iteration  Func-count      f(x)      Lambda
      0          1          93.314    
      1          3         77.6036       10
      2          5         59.7768        5
      3          7         49.7327      2.5
      4          9         45.2948     1.25
      5         11         42.1805     1.25
      6         13          39.769    0.625
      7         15         39.1496    0.312
      8         17         38.1454    0.156
      9         19          36.954   0.0781
     10         21         36.4547   0.0391
     11         23         36.1068   0.0391
     12         25         35.9828   0.0195
     13         27         35.9296   0.00977
     14         29         35.8335   0.00488
     15         31         35.7956   0.00244
     16         33         35.7757   0.00122
     17         35         35.7302   0.00061
     18         37         35.7072   0.000305
     19         39         35.6887   0.000153
  Iteration  Func-count      f(x)    Lambda
     20         41         35.6841   7.63e-05
     21         43         35.6691   3.81e-05
     22         45         35.6528   1.91e-05
     23         47         35.6523   9.54e-06
     24         49         35.6498   4.77e-06
     25         51         35.6483   2.38e-06
     26         53          35.648   1.19e-06
     27         55         35.6464   5.96e-07
     28         57         35.6462   2.98e-07
     29         59         35.6458   1.49e-07
     30         61         35.6438   7.45e-08
     31         63         35.6435   3.73e-08
     32         65         35.6415   1.86e-08
     33         67         35.6415   9.31e-09
     34         68         35.6415   3.73e-08
     35         69         35.6415   1.49e-07
     36         70         35.6415   5.96e-07
     37         71         35.6415   2.38e-06
     38         72         35.6415   9.54e-06
     39         73         35.6415   3.81e-05
  Iteration  Func-count      f(x)    Lambda
     40         74         35.6415   0.000153
     41         75         35.6415   0.00061
     42         76         35.6415   0.00244
     43         77         35.6415   0.00977
     44         78         35.6415   0.0391
     45         79         35.6251    0.156
     46         81          35.625   0.0781
     47         83          35.625    0.585
     48         84         35.6038     2.34
     49         86         35.6038     6.33
     50         87         35.5681     25.3
     51         89          34.811     27.7
     52         91         34.3255     13.9
     53         93         34.3255     6.93
     54         94         33.3519     27.7
     55         96         33.1555     13.9
     56         98         33.0861     6.93
     57        100         33.0672     3.46
     58        102         33.0522     1.73
     59        104         33.0429    0.866
  Iteration  Func-count      f(x)    Lambda
     60        106         33.0282    0.433
     61        108         33.0108    0.216
     62        110         32.9964    0.108
     63        112         32.9924   0.0541
     64        114         32.9841   0.0271
     65        116         32.9807   0.0135
     66        118         32.9761   0.00676
     67        120         32.9761   0.00676
     68        122         32.9719   0.00338
     69        124         32.9706   0.00169
     70        126         32.9681   0.000845
     71        128         32.9674   0.000423
     72        130         32.9629   0.000211
     73        132         32.9624   0.000106
     74        134         32.9599   5.28e-05
     75        136         32.9577   2.64e-05
     76        138          32.957   1.32e-05
     77        140         32.9562   6.6e-06
     78        142         32.9552   3.3e-06
     79        144          32.955   1.65e-06
  Iteration  Func-count      f(x)    Lambda
     80        146         32.9537   8.26e-07
     81        148          32.953   4.13e-07
     82        150         32.9511   2.06e-07
     83        152         32.9509   1.03e-07
     84        154         32.9499   5.16e-08
     85        156         32.9497   2.58e-08
     86        158         32.9496   1.29e-08
     87        160         32.9493   6.45e-09
     88        162         32.9491   3.23e-09
     89        164          32.949   1.61e-09
     90        166         32.9489   8.06e-10
     91        168         32.9489   4.03e-10
     92        170         32.9489   2.02e-10
     93        172         32.9489   1.01e-10
     94        174         32.9488   5.04e-11
     95        176         32.9488   2.52e-11
 TolFun reached. Func-count 176. Final f(x)=32.9488. Elapsed time 2.98
Checking gradient ...

   analytic   diffs     delta

    0.0043   -0.0574    0.0618
   -0.0006   -0.0006    0.0000
   -0.0335    0.0518   -0.0852
    0.0001    0.0001    0.0000
    0.0017    0.0794   -0.0777
   -0.0002   -0.0002   -0.0000
    0.0056   -0.1566    0.1622
   -0.0000   -0.0000    0.0000
    0.0107   -0.0431    0.0538
   -0.0083   -0.1051    0.0968
   -0.0046   -0.0231    0.0185
    0.0004   -0.0933    0.0937
    0.0004   -0.2254    0.2258
    0.0007   -0.0042    0.0049
   -0.0025   -0.0359    0.0334
   -0.0016    0.0204   -0.0220
   -0.0011   -0.0367    0.0356
   -0.0004    0.0602   -0.0606
   -0.0066   -0.0066   -0.0000

  Iteration  Func-count      f(x)      Lambda
      0          1          93.397    
      1          3         78.2287       10
      2          5         64.8018        5
      3          7         58.5794      2.5
      4          9         54.6623     1.25
      5         11         54.6623    0.625
      6         12         54.6623      2.5
      7         13         51.3705       10
      8         15         50.8605        5
      9         17         50.6164      2.5
     10         19         49.1723     1.25
     11         21         48.5081    0.625
     12         23         48.0247    0.312
     13         25          47.655    0.156
     14         27         47.5183   0.0781
     15         29         47.4572   0.0391
     16         31         47.4044   0.0195
     17         33         47.3788   0.00977
     18         35         47.3314   0.00488
     19         37         47.3164   0.00244
  Iteration  Func-count      f(x)    Lambda
     20         39         47.3093   0.00122
     21         41         47.2816   0.00061
     22         43         47.2798   0.000305
     23         45         47.2714   0.000153
     24         47         47.2677   7.63e-05
     25         49         47.2643   3.81e-05
     26         51         47.2429   1.91e-05
     27         53         47.2368   9.54e-06
     28         55          47.234   4.77e-06
     29         57         47.2163   2.38e-06
     30         59         47.1508   1.19e-06
     31         61         47.1295   5.96e-07
     32         63         47.1024   2.98e-07
     33         65         47.0685   1.49e-07
     34         67         47.0551   1.49e-07
     35         69         47.0229   7.45e-08
     36         71         46.9535   3.73e-08
     37         73         46.9347   1.86e-08
     38         75          46.928   9.31e-09
     39         77         46.9252   4.66e-09
  Iteration  Func-count      f(x)    Lambda
     40         79         46.9227   2.33e-09
     41         81         46.9215   1.16e-09
     42         83         46.9183   5.82e-10
     43         85         46.9147   2.91e-10
     44         87         46.9146   1.46e-10
     45         89         46.9137   7.28e-11
     46         91         46.9135   3.64e-11
     47         93         46.9134   1.82e-11
     48         95         46.9128   9.09e-12
     49         97         46.9125   4.55e-12
     50         99         46.9122   2.27e-12
     51        101          46.912   1.14e-12
     52        103          46.912   5.68e-13
     53        105         46.9119   2.84e-13
     54        107         46.9118   1.42e-13
     55        109         46.9118   7.11e-14
     56        111         46.9118   3.55e-14
     57        113         46.9118   1.78e-14
 TolFun reached. Func-count 113. Final f(x)=46.9118. Elapsed time 1.90
Checking gradient ...

   analytic   diffs     delta

   -0.0039    0.0072   -0.0111
    0.0021    0.0021   -0.0000
    0.0331   -0.0090    0.0422
    0.0000    0.0000    0.0000
    0.0004   -0.0009    0.0013
    0.0017    0.0017   -0.0000
   -0.0006   -0.0281    0.0275
   -0.0000   -0.0000    0.0000
   -0.0003   -0.0018    0.0015
   -0.0003   -0.0027    0.0024
   -0.0000    0.0150   -0.0150
   -0.0005   -0.0006    0.0000
   -0.0020   -0.0929    0.0909
   -0.0022   -0.0135    0.0114
    0.0006    0.0001    0.0005
   -0.0002   -0.0004    0.0002
    0.0009    0.0019   -0.0009
    0.0017    0.0017   -0.0000
   -0.0012   -0.0012   -0.0000

  Iteration  Func-count      f(x)      Lambda
      0          1          93.377    
      1          3          77.902       10
      2          5          63.145        5
      3          7          56.938      2.5
      4          9         51.3383     1.25
      5         11         46.6458    0.625
      6         13         46.6458    0.312
      7         14         46.6458     1.25
      8         15         46.3136        5
      9         17         46.2949       20
     10         19         44.5981       10
     11         21         43.7977        5
     12         23         43.6585      2.5
     13         25         43.6585     1.25
     14         26           42.84        5
     15         28         42.5202      2.5
     16         30         42.4726     1.25
     17         32         42.1871    0.625
     18         34          42.122    0.312
     19         36         42.0868    0.156
  Iteration  Func-count      f(x)    Lambda
     20         38          42.032   0.0781
     21         40         41.9998   0.0391
     22         42         41.9998   0.0195
     23         43         41.9998   0.0781
     24         44         41.9998    0.312
     25         45         41.9587     1.25
     26         47         41.9085     1.25
     27         49         41.8434    0.625
     28         51         41.8262    0.312
     29         53         41.8022    0.156
     30         55         41.7995   0.0781
     31         57         41.7975   0.0391
     32         59         41.7927   0.0195
     33         61         41.7902   0.00977
     34         63         41.7869   0.00488
     35         65         41.7859   0.00244
     36         67         41.7832   0.00122
     37         69          41.782   0.00061
     38         71         41.7807   0.000305
     39         73         41.7801   0.000153
  Iteration  Func-count      f(x)    Lambda
     40         75         41.7792   7.63e-05
     41         77         41.7781   3.81e-05
     42         79         41.7777   1.91e-05
     43         81         41.7774   9.54e-06
     44         83         41.7773   4.77e-06
     45         85         41.7772   2.38e-06
     46         87         41.7768   1.19e-06
     47         89         41.7761   5.96e-07
     48         91         41.7761   2.98e-07
     49         93         41.7759   1.49e-07
     50         95         41.7759   7.45e-08
     51         97         41.7758   3.73e-08
 TolFun reached. Func-count 97. Final f(x)=41.7758. Elapsed time 1.54
Checking gradient ...

   analytic   diffs     delta

   -0.0071   -0.1225    0.1154
   -0.0033   -0.0033   -0.0000
   -0.0477   -0.0638    0.0160
    0.0011    0.0011   -0.0000
   -0.0017    0.0868   -0.0885
   -0.0039   -0.0039   -0.0000
   -0.0100   -0.1310    0.1210
    0.0000    0.0000   -0.0000
    0.0032    0.0482   -0.0450
    0.0067    0.0217   -0.0150
    0.0023   -0.0444    0.0468
    0.0022    0.0070   -0.0048
    0.0027    0.0358   -0.0331
    0.0027    0.0486   -0.0459
   -0.0008   -0.0135    0.0126
   -0.0017   -0.0038    0.0021
    0.0004   -0.0042    0.0046
    0.0015    0.0102   -0.0087
    0.0028    0.0028   -0.0000

Laplace 
 
Full GP:
 
Checking gradient ...

   analytic   diffs     delta

   -2.2030   -2.2030    0.0000
    4.2467    4.2467    0.0000
  -13.4153  -13.4153   -0.0000

FIC:
 
Checking gradient ...

   analytic   diffs     delta

   -1.0235   -1.0180   -0.0055
    4.2467    4.2467    0.0000
  -12.9344  -12.9344   -0.0000
    0.3752    0.3752   -0.0000
    0.0957    0.0957   -0.0000
    0.7028    0.7028    0.0000
    0.2347    0.2251    0.0096
    0.3373    0.3465   -0.0092
    0.1788    0.1788   -0.0000
    0.3103    0.3083    0.0020
    0.1460    0.1441    0.0019
    0.1498    0.1498    0.0000
    0.2502    0.2501    0.0001
    0.0953    0.0953    0.0000
    0.1337    0.1337    0.0000
    0.3556    0.3556    0.0001
    0.2201    0.2215   -0.0015
    0.0271    0.0271   -0.0000
    0.1324    0.1317    0.0007
    0.1099    0.1109   -0.0010
   -0.0019   -0.0019    0.0000
    0.1841    0.1841   -0.0000
    0.0958    0.0958   -0.0000
   -0.0179   -0.0179   -0.0000
    0.1801    0.1801   -0.0000
    0.0825    0.0825    0.0000
   -0.0277   -0.0277   -0.0000

PIC:
 
Checking gradient ...

   analytic   diffs     delta

   -2.4573   -2.4562   -0.0011
    4.2467    4.2467   -0.0000
  -13.5125  -13.5125   -0.0000
    0.3753    0.3753    0.0000
    0.0958    0.0958   -0.0000
    0.7028    0.7028    0.0000
    0.3135    0.3095    0.0039
    0.1868    0.1907   -0.0039
    0.1788    0.1788    0.0000
    0.2314    0.2299    0.0015
    0.0945    0.0930    0.0015
    0.1498    0.1498   -0.0000
    0.2515    0.2514    0.0000
    0.0963    0.0963    0.0000
    0.1337    0.1337    0.0000
    0.2581    0.2574    0.0007
    0.1981    0.2001   -0.0020
    0.0271    0.0271   -0.0000
    0.1377    0.1372    0.0005
    0.1372    0.1381   -0.0009
   -0.0019   -0.0019   -0.0000
    0.1852    0.1852   -0.0000
    0.0952    0.0952   -0.0000
   -0.0179   -0.0179   -0.0000
    0.1800    0.1800   -0.0000
    0.0824    0.0824    0.0000
   -0.0277   -0.0277   -0.0000

CS+FIC:
 
Checking gradient ...

   analytic   diffs     delta

   -0.1610   -0.1610   -0.0000
    3.3462    3.3462   -0.0000
  -13.6002  -13.6002   -0.0000
    0.3752    0.3752    0.0000
    0.0957    0.0957   -0.0000
    0.7028    0.7028    0.0000
    0.2911    0.2890    0.0021
    0.2082    0.2115   -0.0033
    0.1788    0.1788   -0.0000
    0.2977    0.2960    0.0017
    0.1296    0.1273    0.0023
    0.1498    0.1498    0.0000
    0.2506    0.2505    0.0001
    0.0956    0.0956    0.0000
    0.1337    0.1337    0.0000
    0.2405    0.2394    0.0011
    0.1809    0.1820   -0.0010
    0.0271    0.0271   -0.0000
    0.1458    0.1449    0.0009
    0.1182    0.1195   -0.0014
   -0.0019   -0.0019    0.0000
    0.1823    0.1823   -0.0000
    0.0959    0.0959   -0.0000
   -0.0179   -0.0179   -0.0000
    0.1801    0.1801   -0.0000
    0.0825    0.0825    0.0000
   -0.0277   -0.0277   -0.0000

EP 
 
Full GP:
 
Checking gradient ...

   analytic   diffs     delta

   -2.1972   -2.1972    0.0000
    4.2467    4.2467    0.0000
  -13.4149  -13.4149   -0.0000

FIC:
 
Checking gradient ...

   analytic   diffs     delta

   -1.0170   -1.0169   -0.0000
    4.2467    4.2467    0.0000
  -12.9336  -12.9336   -0.0000
    0.3752    0.3752    0.0000
    0.0957    0.0957    0.0000
    0.7028    0.7028    0.0000
    0.2254    0.2254    0.0000
    0.3465    0.3465   -0.0000
    0.1788    0.1788   -0.0000
    0.3083    0.3083   -0.0000
    0.1441    0.1441   -0.0000
    0.1498    0.1498    0.0000
    0.2501    0.2501    0.0000
    0.0953    0.0953    0.0000
    0.1337    0.1337    0.0000
    0.3548    0.3549   -0.0000
    0.2221    0.2221   -0.0000
    0.0271    0.0271   -0.0000
    0.1317    0.1317    0.0000
    0.1109    0.1109    0.0000
   -0.0019   -0.0019    0.0000
    0.1841    0.1841   -0.0000
    0.0958    0.0958   -0.0000
   -0.0179   -0.0179   -0.0000
    0.1801    0.1801    0.0000
    0.0825    0.0825   -0.0000
   -0.0277   -0.0277   -0.0000

PIC:
 
Checking gradient ...

   analytic   diffs     delta

   -2.4510   -2.4510    0.0000
    4.2467    4.2467   -0.0000
  -13.5119  -13.5119    0.0000
    0.3753    0.3753   -0.0000
    0.0958    0.0958   -0.0000
    0.7028    0.7028    0.0000
    0.3096    0.3096   -0.0000
    0.1907    0.1907   -0.0000
    0.1788    0.1788    0.0000
    0.2299    0.2299    0.0000
    0.0930    0.0930    0.0000
    0.1498    0.1498   -0.0000
    0.2514    0.2514    0.0000
    0.0963    0.0963   -0.0000
    0.1337    0.1337    0.0000
    0.2574    0.2574   -0.0000
    0.2002    0.2002   -0.0000
    0.0271    0.0271   -0.0000
    0.1372    0.1372    0.0000
    0.1381    0.1381   -0.0000
   -0.0019   -0.0019   -0.0000
    0.1852    0.1852   -0.0000
    0.0952    0.0952    0.0000
   -0.0179   -0.0179   -0.0000
    0.1800    0.1800   -0.0000
    0.0824    0.0824   -0.0000
   -0.0277   -0.0277   -0.0000

CS+FIC:
 
Checking gradient ...

   analytic   diffs     delta

   -0.1264   -0.1264   -0.0000
    3.3462    3.3462   -0.0000
  -13.5887  -13.5887   -0.0000
    0.3752    0.3752    0.0000
    0.0957    0.0957   -0.0000
    0.7028    0.7028    0.0000
    0.2893    0.2893   -0.0000
    0.2115    0.2115   -0.0000
    0.1788    0.1788    0.0000
    0.2960    0.2960   -0.0000
    0.1273    0.1273   -0.0000
    0.1498    0.1498   -0.0000
    0.2505    0.2505    0.0000
    0.0956    0.0956    0.0000
    0.1337    0.1337    0.0000
    0.2395    0.2395   -0.0000
    0.1822    0.1822   -0.0000
    0.0271    0.0271   -0.0000
    0.1449    0.1449    0.0000
    0.1195    0.1195   -0.0000
   -0.0019   -0.0019   -0.0000
    0.1823    0.1823   -0.0000
    0.0959    0.0959   -0.0000
   -0.0179   -0.0179   -0.0000
    0.1801    0.1801   -0.0000
    0.0825    0.0825    0.0000
   -0.0277   -0.0277   -0.0000


 gp hyperparameters: 
 
         0    2.3026    2.3026

Demo completed in 2.753 minutes
