Blackberry syncing to egw 1.4.002 - mixed success but no go. Need help

rtcg 2008-03-05 23:11:56 UTC #1

blackberry syncing aside, I seem to have a working egw server where linux, win32 and Mac users can access their calendar via the web client or icalsrv using lightning/sunbird and iCal. I am still having some issues…one where appointments deleted via sunbird/lightning aren’t truly deleted (they keep showing up in the icalsrv client) users and the other being reoccurring events incorrectly reoccurring on incorrect days. …BUT…those I can live with because the web client works well.

The piece of the puzzle that must work is the blackberry over the air (OTA) client-to-server and server-to-client synchronization. I’ve tried both funimbol3.0.8 and SyncJe 2.42. The funambol client successfully performed a two-way sync of some calendar data on a test user’s calendar, but subsequent syncs did not work. Likewise, the SyncJe client seemed to download the test user’s calendar during that first attempt but failed to download subsequently created test appointments. I enabled the /tmp/sync debugging and told SyncJe to perform a ‘slow sync’ (so that ALL of the appointments would transfer) but I was unable to locate the newly created test appointments in the syncml server logs. SyncJe never seemed to performed a client-to-server sync. No appointments created on the Blackberry made it to the egw calendar.

What is the next step in troubleshooting this syncing issue? egw seems to be my best hope for a platform independent solution that fits my needs, but I seem unable to bridge that last rung to fulfill the requirements given to me.

–
Richard

John_Thomas-5 2008-03-06 01:59:15 UTC #2

rtcg wrote:

blackberry syncing aside, I seem to have a working egw server where linux,
win32 and Mac users can access their calendar via the web client or icalsrv
using lightning/sunbird and iCal. I am still having some issues…one
where appointments deleted via sunbird/lightning aren’t truly deleted (they
keep showing up in the icalsrv client) users and the other being
reoccurring events incorrectly reoccurring on incorrect days.
…BUT…those I can live with because the web client works well.

The piece of the puzzle that must work is the blackberry over the air (OTA)
client-to-server and server-to-client synchronization. I’ve tried both
funimbol3.0.8 and SyncJe 2.42. The funambol client successfully performed
a two-way sync of some calendar data on a test user’s calendar, but
subsequent syncs did not work. Likewise, the SyncJe client seemed to
download the test user’s calendar during that first attempt but failed to
download subsequently created test appointments. I enabled the /tmp/sync
debugging and told SyncJe to perform a ‘slow sync’ (so that ALL of the
appointments would transfer) but I was unable to locate the newly created
test appointments in the syncml server logs. SyncJe never seemed to
performed a client-to-server sync. No appointments created on the
Blackberry made it to the egw calendar.

What is the next step in troubleshooting this syncing issue? egw seems to
be my best hope for a platform independent solution that fits my needs, but
I seem unable to bridge that last rung to fulfill the requirements given to
me.

May I also say that this would be great. If this gets stable, eGW would
be better than Exchange/Blackberry, wouldn’t it?

–
Sincerely,
John Thomas

This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft® Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/

eGroupWare-users mailing list
eGroupWare-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/egroupware-users

Stephane_Gauvin 2008-03-06 12:09:04 UTC #3

Hello guys,

Which version of plugin that you use ? Version of PHP and MySQL ?

Witch BlackBerry model do you have ?

For myseft it works very good now… After a couple of test ans setup changed !!!

The only “bug” I have now is about the charset… The last plugin dosen’t support UTF-8 I think !

French carracters was changed on the blackberry when syncing…

Stéphane

John Thomas-5:

rtcg wrote:

blackberry syncing aside, I seem to have a working egw server where linux,
win32 and Mac users can access their calendar via the web client or icalsrv
using lightning/sunbird and iCal. I am still having some issues…one
where appointments deleted via sunbird/lightning aren’t truly deleted (they
keep showing up in the icalsrv client) users and the other being
reoccurring events incorrectly reoccurring on incorrect days.
…BUT…those I can live with because the web client works well.

The piece of the puzzle that must work is the blackberry over the air (OTA)
client-to-server and server-to-client synchronization. I’ve tried both
funimbol3.0.8 and SyncJe 2.42. The funambol client successfully performed
a two-way sync of some calendar data on a test user’s calendar, but
subsequent syncs did not work. Likewise, the SyncJe client seemed to
download the test user’s calendar during that first attempt but failed to
download subsequently created test appointments. I enabled the /tmp/sync
debugging and told SyncJe to perform a ‘slow sync’ (so that ALL of the
appointments would transfer) but I was unable to locate the newly created
test appointments in the syncml server logs. SyncJe never seemed to
performed a client-to-server sync. No appointments created on the
Blackberry made it to the egw calendar.

What is the next step in troubleshooting this syncing issue? egw seems to
be my best hope for a platform independent solution that fits my needs, but
I seem unable to bridge that last rung to fulfill the requirements given to
me.

May I also say that this would be great. If this gets stable, eGW would
be better than Exchange/Blackberry, wouldn’t it?

–
Sincerely,
John Thomas

This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft® Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/

eGroupWare-users mailing list
eGroupWare-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/egroupware-users

rtcg 2008-03-12 21:10:29 UTC #4

PHP: 5.2.5
MYSQL: 5.0.51
Blackberry/Funambol plug-in version 3.0.8 (from: http://funambol-bb.sourceforge.net/ )
Blackberry Details: Model 8310 (edge) / Version 4.2.2.170 (Platform 2.5.0.30)

Maybe there is a version incompatibility with the Blackberry and version 3.0.8 of the funambol plug-in.

CLorenzo-2 2008-03-13 08:06:44 UTC #5

Hi.

Similar problems here.

Calendar sync seems to work (but i only tried once, i’m going to try to add some cites), it synced from both sides, ie: i got the bb cites in the eg calendar and the eg cites in the bb calendar

but i was unable to sync addressbook, it said sync succesful but no contacts being synced in any way

BB model 8700 (v4.1.0.258)
funambol 3.0.8
egw 1.4.002 up to date with svn
php5 5.1.2.29.50 (SLES 10 sp1)
mysql 5.0.26.12.13 (SLES 10 sp1)

Ldap adressbook

also i was not able to sync with the blackberry apn, i must use the telephone provider apn (the spanish apn from vodafone)

i also want to know if some of you has done sync using the blackberry apn

Thansk

CLorenzo-2 2008-03-13 08:22:53 UTC #6

Added some calendar cites, synced and synced fine

Deleted some calendar cites, synced and synced fine

so calendar seems to work fine

but addressbook still not

thanks

CLorenzo-2 2008-03-13 12:42:21 UTC #7

More Tests

Activated Debug in the blackberry

testing only with contacts

modified a contact in the blackberry

and here are some messages that appear in this log

In XMLContactParse.appendField()->Field not set: Webpage: ->
java.lang.IndexOutOfBoundsException

In XMLContactParse.appendField()->Field not set: Email1Address.: ->
java.lang.IndexOutOfBoundsException

In XMLContactParse.appendField()->Field not set: JobTitle: ->
java.lang.IndexOutOfBoundsException

In XMLContactParse.appendField()->Field not set: Body: ->
java.lang.IndexOutOfBoundsException

some more messages and then

The Server alert code for ./sifcontacts is 200

Is right the ./sifcontacts?

What is the meaning of this alert code?

Any help appreciated

Stephane_Gauvin 2008-03-13 12:53:46 UTC #8

Hello,

OK Now see my new developpement with my new BlackBerry Pearl…

Contact sync works fine in 2 way… But no good UTF-8 charset so “é” was changed for “@”
Calendar work only in 1 way… I’m just able to delete appointment from the BB… So it work only from EGW to BB

I use Funambol 3.0.8 with a BlackBerry Pearl 8130

Thanks,

Stephane

CLorenzo-2 2008-03-13 13:09:58 UTC #9

Hi.

Please, could you set here all your configuration settings in the funambol plugin for doing the contact sync?

(except URL, usarname and password)

also, could you describe your Egroupware setup, ie (addressbook backend in mysql or ldap, default addressbook for the user, etc)

do you know if there are some contacts minimum fields required in order to be able to sync?

thanks

rtcg 2008-03-13 14:47:13 UTC #10

I would be curious to see if additional calendar appointments still sync.

One thing to note in MY case. One particular user had 60 days worth of calendar events to sync. If I try to sync the BlackBerry with all 60 days events in the blackberry, then the web server log shows many hits to rpc.php but the Blackberry will eventually time out (even though there is constant and recent activity at the webserver)

My calendar syncs are successful but no EVENTS are synced in any way.

Does anyone know if there have been any changes significant changes to to egw between 1.4.002 stable and 1.4.002 via svn?? I would think those would be the same, non?

I don’t know what the ‘blackberry apn’ is supposed to be. My Options/Advanced/TCP settings show that my APN is set to my phone provider.

Does anyone have or know of a web page that has a set of diagnostic instructions that one can follow to help diagnose where a sync error occurs? I found some instructions somewhere that mentioned enabling debugging the syncml.php process. I’ve edited my ./egroupware/phpgwapi/inc/horde/Horde/RPC/syncml.php script so that log files get sent to /tmp/sync via the " var $_debugDir = ‘/tmp/sync’; " setting.

Still, I can’t remember how I found where to turn that on and I’m not sure the output of that just that debug is enough to trace the problem.

The go-live implementation of my egw setup is on hold pending this blackberry <-> egw OTA syncing.

It’s frustrating that I’m so close…yet seemingly so far away.

–
Richard

CLorenzo-2 2008-03-13 15:53:57 UTC #11

Hi.

As you can see, in my previous mail, new items added are syncing, but i have few calendar items

Perhaps you could activete the debug log in the blackberry to see what happens

in the main screen pres ALT + LGLG

you get to a screen with a list of items, go to menu, options and change the registry level to debug

then clean the registry and try a sync

come again to this debug screen and read the messages

yes, we get a few syncml related updates

the blackberry apn, is when you left the Advanced options TCP to blank, then you get to the internet by the rim servers.

I ask this because in this way we get a 0 cost full time internet connection, and by the provider apn we have extra costs

[/quote]

Then you should get some files in /tmp/sync (give permissions to write to the web server),

Hope some developer read this

I’m going to post a message to the devs list

rtcg 2008-03-13 20:18:47 UTC #12

I saw the message you posted. You posted that calendar syncing works fine…but it doesn’t. When looking at the log files in /tmp/sync/syncml/synctest I find no evidence that either of the two test appointments that were added to the blackberry client and the egw even TRIED to sync! I see no TEST APPOINTMENTs in any of the the syncms_[client|server]_*.wbxml files.

Are you SURE that if you add a new test appointment to the blackberry and do an OTA sync via funambol, that the appointment does really show up in your egw calendar??

I could only get it to work during the first sync.

–
Richard

Carlos_Lorenzo_Mates 2008-03-13 20:44:52 UTC #13

Hi Richard.

clorenzo wrote:

I saw the message you posted. You posted that calendar syncing works
fine…but it doesn’t. When looking at the log files in
/tmp/sync/syncml/synctest I find no evidence that either of the two test
appointments that were added to the blackberry client and the egw even
TRIED to sync! I see no TEST APPOINTMENTs in any of the the
syncms_[client|server]_*.wbxml files.

Are you SURE that if you add a new test appointment to the blackberry and
do an OTA sync via funambol, that the appointment does really show up in
your egw calendar??

I could only get it to work during the first sync.

I have do the following:

first sync, all my egroupware calendar entries (including past ones) where
copied to the blackberry. And all my blackberry calendar entries where copied
to the egroupware calendar
added a entry in the egroupware calendar
sync. the entry appeared in the blackberry calendar
deleted the entry in the egroupware calendar
sync. the entry dissapeared form the blackberry calendar

I have not tested adding new entries in the blacberry, but i will tests this
also tomorrow and update this thread.

Have you activated the logs in the blackberry?

Greetings

–
Un saludo.

Carlos Lorenzo Matés
carlos AT lorenzomates.com

CLorenzo-2 2008-03-13 20:45:47 UTC #14

Hi Richard.

clorenzo wrote:

I saw the message you posted. You posted that calendar syncing works
fine…but it doesn’t. When looking at the log files in
/tmp/sync/syncml/synctest I find no evidence that either of the two test
appointments that were added to the blackberry client and the egw even
TRIED to sync! I see no TEST APPOINTMENTs in any of the the
syncms_[client|server]_*.wbxml files.

Are you SURE that if you add a new test appointment to the blackberry and
do an OTA sync via funambol, that the appointment does really show up in
your egw calendar??

I could only get it to work during the first sync.

I have do the following:

first sync, all my egroupware calendar entries (including past ones) where
copied to the blackberry. And all my blackberry calendar entries where copied
to the egroupware calendar
added a entry in the egroupware calendar
sync. the entry appeared in the blackberry calendar
deleted the entry in the egroupware calendar
sync. the entry dissapeared form the blackberry calendar

I have not tested adding new entries in the blacberry, but i will tests this
also tomorrow and update this thread.

Have you activated the logs in the blackberry?

Greetings

–
Un saludo.

Carlos Lorenzo Matés.
clmates AT mundo-r.com

CLorenzo-2 2008-03-14 09:28:55 UTC #15

Hi Again.

Tested to add a new calendar item in the blackberry, synced, and the calendar item passed to the egroupware.

For me, at least and with my blackberry model, the calendar sync is working fine.

The addressbook still not.

Stephane_Gauvin 2008-03-14 13:49:59 UTC #16

Hello Everyone,

So see my information test:

1) eGroupWare 1.5.004 (last SVN) + PHP 5.1.6 + MySQL 5.0.54 + Funambol 3.0.8 + BB 8703e

Sync contacts from egw to BB = OK
Sync contacts from BB to egw = OK
Sync calendar from egw to BB = OK
Sync calendar from BB to egw = OK

The only bug I get is about the French characters (charset UTF-8) é,è,ç, etc… Was changed for other caracters like @…

2) eGroupWare 1.5.004 (last SVN) + PHP 5.1.6 + MySQL 5.0.54 + Funambol 3.0.8 + BB Pearl 8130

Sync contacts from egw to BB = OK
Sync contacts from BB to egw = OK
Sync calendar from egw to BB = OK
Sync calendar from BB to egw = BAD (never appear in egw)

AND Charset BUG still here in contacts and calendar !!!

Thanks Everyone,

Stéphane

Carlos_Lorenzo_Mates 2008-03-14 22:07:00 UTC #17

Hi Stéphane

Hello Everyone,

So see my information test:

eGroupWare 1.5.004 (last SVN) + PHP 5.1.6 + MySQL 5.0.54 + Funambol
3.0.8 + BB 8703e

Sync contacts from egw to BB = OK
Sync contacts from BB to egw = OK

are your contacts in ldap or in sql?

where are your contacts stored in egroupware (personal addressbook, group
addressbook)

how you configure the funambol plugin?, with ./sifcontacts?

Thanks

–
Un saludo.

Carlos Lorenzo Matés
carlos AT lorenzomates.com

Stephane_Gauvin 2008-03-15 00:19:08 UTC #18

Hello Carlos,

I Use SQL backend not LDAP

I try personal Contacts and Group Contacts… SAME BUG !!!

I use this settings on Funambol:

https://domain_name.com/egw/rpc.php

For contacts = ./sifcontacts
For calendar = ./sifcalendar

Thanks,

Stéphane

Carlos Lorenzo Matés:

Hi Stéphane

El Viernes, 14 de Marzo de 2008, Stéphane Gauvin escribió:

Hello Everyone,

So see my information test:

eGroupWare 1.5.004 (last SVN) + PHP 5.1.6 + MySQL 5.0.54 + Funambol
3.0.8 + BB 8703e

Sync contacts from egw to BB = OK
Sync contacts from BB to egw = OK

are your contacts in ldap or in sql?

where are your contacts stored in egroupware (personal addressbook, group
addressbook)

how you configure the funambol plugin?, with ./sifcontacts?

Thanks

–
Un saludo.

Carlos Lorenzo Matés
carlos AT lorenzomates.com

This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft® Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/

eGroupWare-users mailing list
eGroupWare-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/egroupware-users

rtcg 2008-03-20 22:46:42 UTC #19

OK… well I installed funambol 3.0.8 on the blackberry 8310, went into log mode, set the blackberry to log debug messages, cleared the logs and did a sync. The http access_log file gave me:

32.148.144.110 - - [20/Mar/2008:15:42:22 -0500] “POST /egroupware/rpc.php HTTP/1.1” 200 1301
32.144.19.38 - - [20/Mar/2008:15:42:28 -0500] “POST /egroupware/rpc.php?syncml_sessionid=syncml-eb953342c64705493b4c4537a3fa5989 HTTP/1.1” 200 876
32.148.49.130 - - [20/Mar/2008:15:42:32 -0500] “POST /egroupware/rpc.php?syncml_sessionid=syncml-eb953342c64705493b4c4537a3fa5989 HTTP/1.1” 200 876

…and the blackberry gave me an error that said: “Synchronization failed. Open tunnel - max timeout.”

Interesting messages in the Blackberry’s debug log include (from top down – just like in the blackberry)

In ConfigurationScreen() flag mailSyncAllowed is true
[DEBUG] Sync Calendar: true

Parsing XML, TAG out-of-memory

Parsing XML, TAG synch-failed

Error in SincManagerImpl.syncModifications(): Open tunnel - max timeout (<–and that IS Sinc …not Sync)

Syncronization failed in SyncmanagerImpl.postRequest(request): connection broken --> java.io.IOException: Open tunnel - max timeout

Exception in SyncMLClientImpl.sendMessage(request): java.io.IOException: Open tunnel - max timeout

Opening the connection nr. 4 in session 120644871896

Starting syncModifications()…

[LOG]Entering syncModifications() in SyncManagerImpl: ‘inSynchronize’ is true

sending
:

1.2
SyncML/1.2
user@domain.com
4
http://server.example.com/egroupware/rpc.php?syncml_sessionid=syncml-eb953342cc6705493b4c4537a3fa5989

fbb606989181 16000 1 1 0 SyncHdr fbb606989181 http://server.example.com/egroupware/rfc.php 200 2 ./sifcalendar ./sifcalendar 3 text/x-s4j-sifeb64 -7247314 PD94bw {snip the rest of the data packet

=== START BUILDING THE SYNCML MESSAGE from mod.xml ===

=== In SyncManagerImpl.prepareModificationMessage() ===

SIF-E -->

<?xml version="1.0" encoding="UTF-8"?> {snip the appointment data}

Fixed date: 20080215T183000Z

original date: Fri Feb 15 18:30:00 America/Chicago 2008

[DEBUG]zn.getRawOffset() --> -21600000

+++ In XMLEventParser.getTimeZoneOffSet(…). Offset: - 21600000

[LOG]Retrieving from device date to add to SIF-E: Fri Feb 15 12:30:00 America/chicago 2008 [1203100200000]

Not set field: AllDayEvent

{skipping some more entries like the above}

Exception, because the event was created on the BB as public and not private: java.lang.IndexOutOfBoundsException

Not set field: Body

Not set field: Location

Exception in XMLEventParser.toString()–> Not set field: AllDayEvent; e.toString(): java.lang.IndexOutOfBoundsException

EventCache:cache empty, initialize it.

{snip what looks to be several more entries similar to “[DEBUG]zn.getRawOffset()” and “Not set Field” ones above}

…and the list goes on with not much in the way of errors.

as for what got captures from the server side, here is a list of the files.

syncml.packetnum
syncml_client_0.xml
syncml_client_1.xml
syncml_client_2.xml
syncml_server_0.xml
syncml_server_1.xml
syncml_server_2.xml

…which I can pastebin if they are of any use.

So what IS the problem? Who can identify the problem? Who can fix the problem? What ‘problem-fix’ needs to be ‘sponsored’?

–
Richard

CLorenzo-2 2008-03-24 11:42:50 UTC #20

Hi Richard.

I think you have a connection problem, could you test with few contacts (one or two)?

And perhaps try to sync only contacts to simplify the tests

Also this could be related at your blackberry being full (out of memory)

perhaps you should post in the funambol forums regarding the blackberry client, as it could be a funambol problem.

I have oppened a bug in the community site.

here is the link

http://www.egroupware.org/egroupware/index.php?menuaction=tracker.uitracker.edit&tr_id=1454

perhaps you can vote for it

Thanks